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ABSTRACT 

The Innovative Teaching Group (ITG) at Cleveland 
State University, committed tc novel and untried teaching methods, 
has organized papers from the faculty and other resource people into 
an anthology on teaching. After the general introduction, the 
contents are divided into threc=i parts: Insights and Issues at Large; 
Strategies and Tactics in Practice; and Evaluating Instructional 
Effectiveness. The first section on teaching addresses itself to the 
broad-gauged consideration of teaching, including such topics as 
innovation, the modern student, and learning theories. . The fifteen 
papers in section two speak in specifics about curricular and course 
design and instructional techniques. The third section contains 
p:pers presented at a conference titled "Faculty Development: 
Evaluating Teaching" sponsored by the ITG. The major goal of these 
papers was to consider and define the parameters of evaluating 
classroom instruction for the improvement of learning and for the 
professional advancement of the faculty. Papers in this section 
include: the feasibility of evaluation; analysis of roles of faculty 
by students, adm3.nistratorS;. and faculty; and correlation between 
administrator, colleague and student ratings. . (Author /PG) 
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PREFACE 



The editors are grateful to many good people who contributed to 
the creation of this anthology. Principally, of course, they owe thanks 
to each of the contributing authors who devoted time and energy to the 
initial compositional effort and then granted the editors an unlimited 
fund of patience while the book was put together, 

A very special thanks must be paid to the Cleveland Foundation. 
Without its support, this anthology would still be awaiting final typing 
and editing. Like so many other products of the Innovative Teaching Group 
(I.T.G.) at Cleveland State, the anthology on teaching was finally made 
possible because the Foundation funded the Center for Effective Learning 
in November, 1972. Brainchild and heir of I.T.G. , the Center enjoys a 
fiscal viability the lack of which hampered I.T.G. 's ability systematically 
to encourage instructional development here. In many ways, then, the 
completion of this tome is symbolic of what has happened to extend or give 
birth to much that was initiated or envisioned by the Innovative Teaching 
Group. 

• Finally, the editors wish to thank those whose skills in typing and 
editing make such enterprises — like books — readable. Specifically, 
our thanks are extended (many times over) to Jean C. Carr, whose superb 
editing increased the literacy of the work greatly and in a very English 
way, and to a triumvirate of typists — Eva Czech, Gwendolyn ^Grady Mary 
Kelly whose skills are exceeded only by their patience. 
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GENERAL INTRODUCTION 
THE EDITORS 

About a year ago, the editors of this anthology were not editors 
at all. Neither did they om pretensions in that direction. But they 
were involved — one as unofficial coordinator and the other as member 
of the Steering Committee — in a rather unique, if unofficial, organi- 
zation at Cleveland State. It was called the Innovative Teaching Group. 

I.T.G. had begun in January or February, 1971, by a number of 
teachers in Arts and Sciences and in Education. To a person, they were 
committed to effective instruction. Most considered themselves innova- 
tors (hence, the name) but more often because their concern for the 
results of teaching was novel than because they adopted untried methods. 
At any rate, hardly anyone in the group was in contact with other like- 
minded colleagues. By dint of interesting and often active debate and 
of a sense of camaraderie^ I.T.G. took hold, meeting regularly on a 
bi-weekly basis for the rest of the yea?:. 

Nothing earthshaking happened. It is true. Or perhaps something 
very significant did transpire: about forty faculty members had identi- 
fied themselves as a steadfast core of "innovators" in the classroom. 
The Group was firmly enough entrenched at any rate that it decided to 
continue on a structured basis during the 1971-72 academic year. A 
Steering Committee was formed and a number of new ventures were launched 
— a monthly newsletter, a formal lecture/seminar series on teaching, a 
subgroup on evaluation, a subgroup on an Interactive Teaching System, an 
all-University conference on faculty development. As each took hold and 
more faculty indicated their concern for effectiveness in the classroom, 
the idea occurred that it might be appropriate- to organize the papers 
presented in the seminar series and those submitted at large from the 
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faculty into an anthology on teaching at C.S.U. As usual, the response 
was encouraging. So the editors became editors. 

That more than a dozen faculty responded so promptly to a general 
invitation to submit papers about their experiences in or thoughts on 
teaching is indicative of the sources of I-T.G.^s success. That is, 
faculty are anxious to devote energies to the teaching enterprise in a 
professional manner — with as much :rigor and according to the same 
ground rules as research demands. They are willing to document and 
evaluate their work in the classroom, to distill their data and thoughts 
and to submit the results to the critical review of colleagues. 

Until I.T.G. was created there were precious few opportunities 
at C.S.U. for even casual exchanges among instructors about teaching. 
Some faculty wondered whether they were along in con;:entrating on teach- 
ing. The chances to communicate to a wider audience were even more 
limited. Most professional journals provide scant space and incentives 
for articles on teaching. A few disciplines either have or are develop- 
ing journals specifically geared to teaching; they are important. But 
their audiences by definition are limited to the profession. Little in 
the way of transdisciplinary dialogue is stimulated. There are one or 
two transdisciplinary journals; but at least one of them is both new 
and international in appeal. The chances for publication are slim. 
While there are some in-house newsletters on teaching at various univer- 
sities, their appeal is provincial and their space is tight • In short, 
academe has never really organized itself to provide the outlets neces-^ 
sary for the systematic development, documentation and communication of 
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the teaching transaction. Given this situation, universities have been 
reluctant to reward teaching rather than research* 

To a limited degree, the seminar series provided one vehicle for 
the presentation' of ideas in a systematic way. The six papers prepared 
for the series last year have been included here. The editors also 
entertained the modest hope that the anthology might widen the oppor- 
tunities 'for other faculty to document their efforts. Fourteen papers 
were volunteered as a result of our invitation last Spring, The last 
three papers partially document the events of I,T,G,'s first conference 
on faculty de\elopment last May, the special theme of which was evalu- 
ating teaching. 

The third chapter deserves specia^ mention. It was not clear at 
first that tae papers of the resource people to the conference from 
outside the University ought to be included in this publication. As our 
thinking advanced, however, it became clear that the issue of evaluating 
— - as sensitive as it is — ,must. be confronted. Gonsidf xtions of effect- 
ive instruction are haphazard at best unless they include something about 
documenting ef f ectiveness » Excellence in teaching can and must be demon- 
strated. It is not simply an intangible quality that some have and others 
may never acquire. Still, the salient .characteristic of the third chapter 
is its concentration on the "politics" of evaluation. The chapter does 
not constitute a "how-to-do-it" manual. Perhaps, before faculties as a 
whole are able to consider serious, consequential evaluation procedures, 
they have to process the delicate questions about what evaluation means at 
the gut level* In that sense, the papers in the last chapter are extremely 
valuable* 
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As the papers for the first two sections or chapters came in, 
three patterns emerged. First, it became obvious that nearly all the 
contributors view teaching systematically. They regard particular 
techniques as part of whole cloth. Classroom instruction is not a 
haven for failed academic researchers; rather it is the testing ground 
for men and women who take seriously the notion that teaching still 
forms the central mission of public higher education, l^ile some of 
the papers are based more firmly on first-hand impression and specula- 
tive reflection than on hard data, each is constructed with a view 
toward coming to complete terms with the challenges of teaching. As 
first statements of conclusions or positions, the collection is remark- 
able for its solidity. 

The second pattern was not surprising but still gratifying. The 
papers represent most discipl3-ne areas — business administrations, edu- 
cation, law and J in the Arts and Sciences, the three vnajor subdivisions. 
As has happened so frequently in various T.T.G. meetings, teachers find 
that colleagues in disciplines quite removed from their own in content 
have a great deal pertinent to contribute in. method. At a time when 
crossdisciplinary studies and cooperation seem to run into so many snarls 
in fact, perhaps frank exchanges about mutual teaching problems provide a 
good basis for breaking down imagined barriers between content areas. 

Finally, the material thgt came in almost organized itself in ways 
that illuminated one or another aspect of teaching. The editors had to 
do very little in the way of forcing thi:^ or that paper into a strange 
category. The first four papers in the anthology neatly formed a coherent 
chapter about teaching as a general activity in the University* The 
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intellectual tensions that enliven this first section were unintended 
and altogether organic. The second chapter is less neat and coherent 
perhaps but it has a cohesive quality. All its papers are concerned 
with the practical. How can we maximize learning in practice? What 
are the most appropriate learning environments and conditions for a 
particular body of students and a special body of information? How 
can we test out our results to know whether i-ja have succeeded? Again, 
the editors found taht the material worked or fitted well by itself. 
Each paper stands on its own merits, yet related thematically to one 
or another. 

Teaching an the central mission is - or should h<i - what public 
institutions of higher learning are all about. This anthology on teach- 
ing stands as testament to the widespread and serious commitment to 
instructional excellence at The Cleveland State University. 



PART ONE 



ISSUES AND INSIGHTS IN THE LARGE 



PART ONE 

ISSUES AND INSIGHTS IN THE LARGE 

Inevitably, discussions of teaching at the University level take up 
philosophies of education. Differing approaches revolve around innovatic n 
effectiveness , and learning . Each concept is vigorously debated. What 
is innovative teaching? Must teaching be innovative to be effective? 
Should we concentrate on teaching; or on learning strategies? And each 
question and attendant controversy calls forth a veritable host of troub.'.e 
some sub-issues. The continuing problem is that sub-issues become prin- 
cipal foci. The trees obscure the forest. 

The first section of this anthology on teaching at Cleveland State 
University addresses itself to the broad-gauged consideration of toachinj;. 
Each essay in this section attempts to take the measure of the entire 
forest or at least to describe the major types of flora which compose it. 

The four authors — Professor Carlton Qualey of History, Professor 
Lee Gibbs of Religious Studies ^ Professor David Santoro of Education, and 
Professor Dale Brethower of Psycholog}^ — have a common commitment. They 
seek instructional excellence. Perhaps effectiveness is the more apt nojn 
Surely instructional innovation, as a goal In and of itself, is not the 
objective of any of them. Beyond this mutual agreement, the four divide 
into two distinct schools of response to the problem. 

Oualey and Gibbs stand as representative t-^pes. Like most faculty 
concerned with the quality of the educational experience, their approach 
is intuitive. Their convictions about the essential conditions for effez- 
tiv>? teaching have matured through long, first-hand experience in the 
classroom. For them, the focus is the teacher. lAJhat, they ask, are his 
responsibilities? I^Jhat can he or she do to insure quality and meaning 
for students? While the answers Qualey and Gibbs advance are not explic- 



itly or directly based on research into formsil learning theory, they are 
insightful and provocative. Together, the first two essays set a tone 
appropriate to the seriousness of the issue. 

Professor Qualey, clearly, is sceptical of innovation. Indeed, the 
dicta he delivers at the end of his first paragraph raise the question 
vhether the teacher can do an3rfching at all with or for students whose 
skills and intrinsic motivations are not as well honed as these of the 
nation* s very best undergraduates. This notec, however, is merely a cau- 
tion. Qualey^s main concern has a more positive point to it* He calls 
all university teachers to very high standards of performance. Those 
vho do not pass close inspection as good classroom teachers must not 
receive tenure. Qualey is unforgiving in his low regard for gimmickry 
and for teachers who are not researchers. His stance is based firmly on 
the conviction, however, that most, if not all, students recognize and 
respond to tough Intellectual standards, and that innovation, loosely 
used as a cover for ineptitude, must not be condoned. He does not re- 
ject innovation. He insists only that it serve excellence. These 
challenges are well taken. They recall for us the verities which. Qualey * s 
forty years cf teaching experience have confirmed. Those truths must 
inform today* s interest in innovative techniques. 

Professor Gibl^." identifies unreservedly with innovative trends in 
contemporary teaching. Teaching he argues, must have an immediacy if it 
is to be effective. Teaching must relate directly to a generation of 
students vho question the basic tenets and modus operandi of the academy: 
the lecture mode, historic ism, value-free inquiry and the separation 
between thought and action. Gibbs wonders whether the traditionally 
trained Ph.D. can possibly meet this challenge from the contemporary or 
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sensuous student. The instructor is already strung-out as a result of 
severe struggles within the profession between academic Left and Right, be- 
tween advocates of tradition and of experientialism, of research and of 
teaching. If he relies solely on his limited training in teaching, he must 
fail. In order to save the "wonnded enterprise" of the university, the 
instructor must move to new conceptions of liberal education, of knowledjie 
and truth and of the student as a total being. He will, as a result, aban- 
don traditional classroom modes in favor of structured innovation. One nay 
ask whether the student type, which Gibbs describes, inhabits to any sigr.i- 
ficant extent the public and especially the urban commuting university. It 
is probably true, nevertheless, that most faculty, regardless of institu-- 
tional affiliation, have felt and responded to the hot breath of the cour:- 
terculture student. Gibbs 's challenge to us is to respond creatively anc* 
generously to new student expectations; like Qualey, he asks that we makd 
the classroom a center for real intellectual communication. 

Professors Santoro and Brethower consider the problem of education 
from a different perspective. Both are trained students of learning theory; 
both are researchers into the learning process, as well as classroom practi- 
tioners. Consequently, and significantly, they emphasize learning rathe:' 
than teaching as the critical focus for attention and the final measure of 
instructional effectiveness. And, although their perspective is as broa<I 
as that of Qualey and Gibbs, Santoro and Brethower introduce a more sang^iine 
note about the possibilities - for improving learning. Indeed, both would 
object strenuously to the implication housed in Qualey ^s piece that ther^ 
are good teachers and bad teachers and little can be done to transform tie 
latter into successful practitioners. Tf we concentrate on student lean- 
ing, they argue, each of us can take steps in his own classroom to in- 

ERIC 
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crease learning in measurable ways. In the process, of course, one becomcjs 
a better teacher. R-'^ther than implore, however, Santoro and Brethower prci- 
scribe concrete tactics and strategies which instructors can apply in the 
cla-:sroom. 

Santoro separates the problem of instructional effectiveness Into foir 
manageable sub-problems: is learning? How can we assess it? What 

can be done to promote it? How can we measure it? Traditionally, he 
argues, the principal models of education — the mental-discipline , the ex- 
perimentalist and the me n t a 1-h y g i e n e models — either have confus^'-d the 
issues or have been unable to answer any one of them satisfactorily. The 
reason for this failure is that each model takes the student as the termi* 
nal object or the end product of the educational process. \^Jhat we must do 
instead is to recognize that skill acquisition (the ^'functional ability to 
perform a specific task") is the goal of education. This is the ''legiti- 
mate behavioral phenomenon of classroom learning." Once we accept that, 
Santoro concludes, we can construct "a comprehensive, logical and inte- 
grated model of educational practice for describing, assessing and treating 
basic learning phenomena." This model provides for the social factors 
which impinge on rates of skill acquisition and it allows indi'^idual in- 
structors to arrange the classroom environments, including their own 
role(s) in it, to maximii^e learning, for each student. The implications 
of Santoro's theoretical statement are many. The most significant of 
them may be that, if teaching is an art, it must have some very precise 
operational features in order to be successful as well as aesthetic. 

Professor Brethower reinforces Santoro *s argument. His paper, plus 
the critique and commentar}^ that were f^ngcr..:lered when he delivered it to 
an Innovative Teaching Group Seminar a year ago, suggests that the body c-f 
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research on learning is already complete and precise enough that, were in- 
structors to utilize its precepts in their own teaching, they would work a 
"revolution" in higher education. Brethower provides, as Tninitnum organi::a- 
tion for the event , a six-step schema that every instructor , regardless of 
discipline, can adopt to stimulate measurable learning: (1) State instruc- 
tional objectives clearly, (2) devise testing instruments which are gear-jd 
to those objectives, (3) devise study material that encourages st'odents to 
perform tasks directly relevant to those objectives, (4) employ classroom 
methods which maximize student participation in approximations to the fiial 
objectives, (5) provide examples and non-examples of ways which the objec- 
tives are and are not met, (6) design mechanisms so that students obtain 
frequent and immediate feedback about their progress. Each of these pre- 
cepts is based on valid experimental research. In short, Brethower, like 
Suntoro, calls for the systematic examination and reor^';anization of instruc 
tional methodology by each teacher in order to foster learning, the piin- 
cipal object and basic rationale of higher education. 

It may well be that the differences in emphasis among the four au- 
thors in this section between teaching and learninf; is more apparent thcu 
real. Both Qualey and Gibbs demand that instructors respond to and sti- 
mulate their student^ in intellectually respectable and valid ways. They 
call for excellence. Santoro and Brethower argue that such energy can 
be channeled in measurably effective ways. They give precise definitioi 
to standards of excellence. 
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INNOVATION? 
Carlton C. Qualey* 

OiVv': has the feeling oa listening to purportedly innovative ideas and 
experiments that **this is where I came in*'. The ideas and experiments ara 
much the same as those attempted in generations past, expeci al'/?' in the 
1930s. After thirty-six and more years of teaching history in both experi- 
mental and conservative institutions of higher learning, I have concluded 
that two ideas have been especially useful. One was given me by a president 
under whom I* was privileged to serve: "We hire faculty for our best students 
The other is an old concept: "A university is vjhere university work is 
done. 

These two ideas do not exclude innovation, but they do involve high 
standards of performance by faculty and students, expecially by the 
instructor. The matter of standards is always troublesome. Granted that 
there are no absolutes, it is nevertheless possible to insist that in 
each of the university disciplinos certain levels of mastery and under- 
standing must be maintained. The higher levels, the more distinguished 
the university. It will be said that standards are relative; that one 
must take into account the background of the students. To this it can be: 
replied that if the students cannot meet the standards they should not 
be in the university. Actually, no matter what the quality of background 
of the students, I have found that students deeply resent lowering of 
standards to fit their supposed poorer preparation. They want quality, 
and woe to the instructor who does not recognize this fact. No amount 
of classroom entertainment or fraternization can cover up lack of 
genuine scholarly standards. 

*Visiting Professor of History dux ing the year of 1971-1972 at Clev'iland 
State University. 
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Students very quickly find out whether or not an instructor really 
knows his subject. They sense it by his security in fielding questions 
and by his finger-tip knowledge of bibliography,, They find out by check- 
ing out what the instructor says. If the instructor is merely repeating 
the textbook, the students will stop attending. They further test the 
instructor by the kind and quality of his examinations. Through secondary 
schools most students have been accu^-jtomed to objvective examinations. 
They kno'7 what it takes to achieve grades. It is a kind of gamesmanship, 
and rarely has much connection with genuine learning. When students 
encounter essay questions or problem- solving test situations, they are 
challenged. The good ones will come through. Again, however.^ it depends 
on the nature of the questions asked or the problems to be solved. And 
again it is the instructor's quality in making out the examination that comes 
out. It is extremely difficult to make out good examinations. The possi- 
bilities of misunderstanding are endless. But the examination can be one 
of the best instructional devices available if it is not used punitively. 
The students quickly Sense the instructor's intent, and they are good 
judges of fairness. 

Once the instructor has survived the first weeks of testing by the 
students, a condition of trust should develop. This trust is essential and 
must be established before a proper learning situation can be created. 
When the element of trust is there, communication, without reserve, can 
be expected to develop between the instructor and bis students. 

One vital element in communication between an instructor and his 
students is the intap<>ible quality of [genuine scholarly enthusiasm. I dc 
not beleive that one can be an effect, ive teacher unless one is also engaged 
in productive scholarship. The students in any class soon find out if ar 
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irctructor is only one jump ahead of them and is merely rehashing secondary 
material. They become excited when an instructor can, in effect, create 
his subject in the classroom. Communication involves, of course, command 
of language, felicity of phrasing, a degree of wit, and ability io Gdy 
the same thing in varying ways until comprehension is established. Effect- 
iveness of communication is measured by responses, either in the form of 
questions and discussion or in essay examinations. Ideally a class shoulc. 
be small enough for full communication to take place. However, even in a 
large class or lecture, communication can be established if the components; 
described above have been secured. I have been in large lecture groups in 
which the tensions of excited communication have been high. I have also 
seen small groups that were .^ead as could be. 

Unfortunately there are men and women who should not teach. Industrie 
ousness has brought them through f?.raduate school; recommendations have 
brought them to university appointraents, ; and the protection of classroom 
sanctity has preven;:ed their discovo^ry by busy chairmen or deans. Only 
when they are notoriously bad has their ineptitude been brought to light 
before tenure is conferred. Then there is that bane of all colleges and 
universities, the person who regards teaching as the price paid for 
research facilities. Most unfortunate are those vjho can neither teach 
well nor produce anything worth publishing. The really able teachers in 
any department are usually few in number. They are not necessarily those 
with huge classes which often indicate either a ''pipe** course or a required 
one. The really good teachers can be detected by the number of able stud ei.l.-^ 
who seek out their courses. 

Much ink is being spilled these days in the matter of tenure. The 
American Association of University Professors has traditionally maintained 



that tenure is essential to academic freedom, that is, freedom from un- 
reasonable interference with research and instruction. Probably a college* 
instructor is no more sacrosanct than members of other pr of sssions • On 
the other hand, tenure does give some security, and this is perhaps 
necessary to unworried endeavor. If one takes the latter line of thinking, 
tenure can be a constructive device. The catch is that the instructor's 
endeavor shall be of sufficient quality to warrant prelection, o really 
satisfactory arrangement has been proposed. Permanent tenure from the 
time of early service seems to be goine; out of favor. Contract tenure 
seems somehow mechanical and is open to abuse. Student evaluation has 
yet to be proved reliable, except perhaps in single courses. One comes back 
to the principles first stated. After a preliminary period of perhaps three 
years, it should be clear to a vigilant department head or departmental com- 
mittee on tenure whether or not an individual is worthy of probationary tenure, 
say of five years. Final determination of continuous tenure would then be 
made. Within these eii^ht years there would be opportunity for interim 
evaluations if needed, thus giving ample time during -an instructors market- 
able age for search for a position elsewhere. In any ca.i=2, innovation or 
none, mediocrities need not be retained. 

The use of gadgetry in the classroom has always been controversial, 
but some is undoubtedly useful. Audio-visual aids are available, computer 
aids are now commonplace, demonstrations are an old standby, field trips 
are appealing, and exercises of infinite variety are possible. However, 
such things can become mere entertainment or a means of using up required 
instructional time. One always comes back to the problem of basic under- 
standing and of intellectual excitement. 

Then there are the variations of organization of a classroom of students: 
committee of the whole; panels of five or six; teams taking portions of 
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subject matter; self-evaluation (an extremely hazardous device); research 
papers, etc. I doubt that there is any program that has nou been tried 
somewhere. I know I have tried a great variety of them. Eventu.ally on^. 
comes to certain ways of doing thing;:^ in the classroom tha t work for one'^ 
self. One comes by this knowledge painfully and after a good deal of ex- 
perience. The able instructor will come to it fairly quickly and will 
continue to experiment. The mediocre will not succeed in any of the 
experiments. 

Innovation in the hands of a truly promising instructor can be very 
beneficial. The lesson should be obvious. The emphasis must be on recru .t- 
ment of able scholar-teachers, on making conditions for them that will 
promote their efforts j and on rewarding them with tenure and promotion. 
Tenure should not be given unless earned. The rule is a very toiigh one, 
and it makes the life of a department chairman at time a bed of thorns. 
But how else can a university do universif:y work and achieve excellence? 
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THE SENSUOUS STUDENT AND THE STRUNG-OUT PROFESSOR 

Lee W. Gibbs ^ 

Livirxg and working in a university, perhaps the most disturbed insti- 
tution in a society showing all the signs of acute cultural crisis, is not 
very comfortable. Yet, as with every other aspect of the present cultural 
situation, this one is full of great danger and great possibility, Ti: may 
be helpful to point out some of the basic tensions and conflicts which some 
of us with brief tenure in these institutions feel, having so lately left 
the ranks of students and having learned of faculty unrest. 

In writing this paper on innovative teaching, I have tried to steer a 
course between abstract generalities l:hat only repeat what others have al- 
ready said and concrete personal observations which will not interest or 
help others. The paper is divided into three iiajor sectioMr?; the first two 
are analytic and diagnostic, while the third ±s practical' and constructive. 
The first section is an analysis of the nature and implications of the 
current student protest against a tradition-bound academic institution. 
Section two sets forth three areas of tension and conflict precipitated 
for the sensitive and dedicated teacher by student pressure for educational 
reform, Tlie third section suggests three methodological presuppositions 
which may be used to legitimate innovative teaching and to '•ui2.d bridges 
between conflicting inter -c>cs of students and faculty 'aambers, 

I, 

Many intelligent and sensitive students who have been caught up in 
their own cultural revolution have now been protesting for several years 
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against what they believe to be the bankruptcy and iTninorality of the present 
educational system. They are in rebellion against an educational system 
which they perceive to be intent on making them conformists to an outdated 
social order • The contemporary student challenge to tradition-bound aca- 
demic institutions includes the following intimately related but distin- 
guishable constituents: (1) a critique of the excruciatingly boring and 
relatively ineffective lecture method as the primar}^ mode of teacher-student 
communication in an age determined by electric media; (2) an anti-histor cal 
bias which is oriented away from the past toward the possibilities of tha 
future and especially to the meaning of what is happening at the present 
moment; (3) an attack against the detached, objective stance which is nur- 
tured by the whole intellectual style of supposedly value-free universities; 
and (4) a commitment to the unity of thought and action. 

Critique of the Lecture Method 
The present generation of students is not inclined to accept anythi ig 
without question. Nevertheless, lectures still dominate the typical class- 
room as the primary mode of teacher-student communication • This instructional 
technique emphasizes almost entirely the rational, conceptual, and verbal 
level of communication at the expense of ai]. others • The lecture symbolizes 
the old top-down , hierarchical structure of teacher authority and studen t 
dependence. The professor-lecturer, rigorously trained to be an abstract 
intellectual, tends to regard and treat himself and his students as detached 
minds without bodies. Students raised on the "cool" participational knc^^ledge 
of television and other electric media are no longer stimulated or satisfied 
with the "hot" knowledge of the traditional classroom lecture. Especially 
in the present atmosphere of social crisis and urgency, students care little 
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for generalizations spoon-fed to thern for purely abstract reasons. They 
demand to see concretely and humanly why they are important. 

The rigid asceticism, sublimation, and repression of bodily energy /.nd 
emotional drives required on the part of the normal student as he endures 
the ordeal of passively sitting through a lecture which bores him to tears 
is relieved only by the final ringing of the bell. Radical students are 
now raising the question about whether or not the price of such sublimat .on 
and repression is too high. They are asking for new curricula and new p'lda- 
gogical techniques which will move the emphasis in the classroom from co:i- 
ceptual ab.s'tractions to concrete h man beings vith their concrete bodies 
and repressed desires and feelingf-. The student criticism of dehumanizi ig , 
disembodied abstractions is part of a general romantic protest against "the 
fallacy of misplaced concrf^teness" , a protest on behalf oi the living body 
as a whole. Students are now insisting upon the recognition that there Is 
an undeniable sensuous, ecstatic, Dionysian element implicit in ever^; hunan 
body, in all human cognition, and in all the events cognized by human beings 
Students are demanding an educational process which will not only change 
their thinking and behavior but also their sensing and feeling — that is to 
say, their bodies and their awareness of their bodies. 

The Anti-Historical Bias 
The spiritual revolution which is taking place among today's youth is 
marked by a decisive contempt for the past, \^^-lereas the traditional univer- 
sity has regarded Itself as a treasure house and transmitter of human 
wisdom carefully accumulated and preserved from the collective experience 
of the human race, student radicals have acquired an active prejudice ard 
out-right hostility toward the past. Some extremists actually advocate 
deposing all their professors and locking up all the libraries — all in the 
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interest of gaining a truly relevant education unblurred and unhindered by 
history. Not long ago, while speaking with one of my more radical studerts, 
I asked him where he planned ^.o find the purified wisdom he wa? seeking. 
The student responded: "We of the younger generation will get it from ore 
another. And each of us will contribute his share from here*' — and he 
patted his heart. • 

This attempt to flee or escape from the oppressive responsibility of 
the historical past appears in at least two different modes. The first 
derogates both past and present for the sake of the future. Here the pa^it 
is opposed mainly because knowledge of the past is believed to prevent con- 
temporary men from expecting or creating a new future. The second opposciS 
the past because i •:: believes that bondage to the past prevents contemporary 
men from enjoying the present and seeking for the meaning of what is happen- 
ing au the present moinent. But in either mode, the human past is viewed as 
an obstacle to human fulfilment — a barrier to be demolished. 

The Attack Against Objective, Value-Free Universities 
The current student generation is well aware that modern civilization 
faces the severest political, moral, and ecological emergency in its history. 
Students raise their voices in prote':^t against what they feel to be the 
inhuman, insensitive attitude of modern science in both its theoretical and 
applied fields. The objective, detached outlook, nurtured by the whole 
intellectual style of supposedly value-free universities, mercilessly elimi- 
nates enjoyment from man's relation to nature and promotes an aggressive, 
dominating attitude toward reality. For these students, the Viet Nam War 
symbolized in America what seems most dangerous to the world — -its high 
level of science and technology and low level of wisdom and moral discern- 
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ment. The war is for them the most highly rationalized and detached war 
ever fought and yet the most savage. It demonstrates how reason and 
civility can cover technological enterprises laden with destrvictive, demonic 
implications • Yet, in spite of the complicity of most universities in per- 
petrating the detached, objective outlook of modern science and technology, 
many students have not completely given up on the universities and -ire still 
seeking to find in them a haven where they can freely think and speak about 
ultimate questions, moral values, quality of life, the meaning of human 
suffering and hope. 

Commitment to the Unity of Thought and Action 
One final observation vjill help to illumine the present conflict of 
students with the universities. The separation between thought and action, 
which university life enforces, seems to the students illegitimate. Faculty 
members are professionals in the realm of thought. They move on occasion 
from thought to action and back to thought again. Students, on the other 
hand, customarily see their goal as action* They move on occasion from 
act to thought to act again. Thus, while faculty enthusiastically promote 
programs of continuing education in which those working in the field are 
brought back from action to thinking, students keep pushing for more atter- 
tion to the kind of thinking that issues in action. They are impatient 
with the fact that a university is a place where thought issues only in 
further thought, talk in further talk, answers in further answers. They 
are convinced that awareness grows only through conscious , accurate action, 

II. 

The student pressure for academic reform and innovation places the 
sensitive and dedicated teacher ±n a very embarrassing and painful position. 
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The young doctoral candidate gets his Ph.D. and goes out to teach. Then 
comes the shock — courses to prepare and worst of all, students. He quic'ily 
discovers how untrained to teach and how incredibly ill prepared he is for 
the tasks now facing him. The young teacher quickly finds himself caugh : 
up in three areas of conflict where the opposing sides continually bid for 
a kind of total allegiance to one side or the other. These three conf li :ts 
arise between two kinds of i.ti-intellectualism, between tradition and ex- 
perience, and between research and teaching. 

Anti-Intellectualism of the Right and the Left 
The anti-intellectualism of the academic right is the province mainly 
of university faculties. They consider that authentic knowledge and truth 
are exhaustively manifest in the accepted and well defined academic fields. 
Anything outside the fields of high competence represented by a given 
faculty could not possibly qualify as serious academic study. Any who 
challenge the system are ipso facto judged to be anti-intellectual. 

The anti-intellectualism of the academic right has been undergirded 
by the unnatural divorce it imposes between personal experience (subjec- 
tivity) and rational analysis (objectivity) . The "myth of objectivity" 
holds that there is but one way of gaining access to reality, namely, tc 
cultivate a state of consciousness cleansed of all subjective distortion 
and all personal involvement. Only what deriv^es from this objective 
state of consciousness qualifies as knowledge. 

The exclusiveness of this view of knowledge as the ruling dogma of the 
university has been especially damaging to the humanities, and hence to 
the healuhy tension that should exist between the value questions inherent 
in these subjects and the supposedly value-free pursuit of objective 
knowledge. This myth has not only narrowed the scope of legitimate ques- 
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tions to be raised but also bi= tended to support as inviolate tliose meth- 
ods, disciplines, and subjects which the student finds entrenched and im- 
posed when he arrives • 

The second kind of anti-intellectualism is found among many of the 
more activist students, who use various rationalizations to avoid learnirg 
hov7 to think well and clearly, and/or to avoid thinking about anything tl at 
does not appear personally relevant upon the day of arrival upon campus. 
The attack on objectivity tends to become an extreme and unjustified attc ck 
on all research and all intellect. Intellect alone is not going to save 
the world or civilization, but neither will be worth much without it. 

The sensitive professor is torn between what is construed as intell<!C- 
tual rigor on the one hand and a reformed educational system characteriztid 
by contemporary relevance and good human relations on the other. 

Tradition versus Experience 
Most universities are characterized by the programmatic refusal to 
encourage unity between the storehouse of traditional material and the fresh 
data of present experience. The university and its faculty tend to compart- 
mentalize these, aided by the noti.on of objectivity discussed above. Th 2 
student is asked to lay aside the imperious questions and impulses of his 
experience and to enter the classroom with his mind a blank slate so that 
he may absorb as much of the academic apparatus and tradition as possible. 
He is also expected to learn to achieve detachment and objectivity. Wise 
and cynical students have observed that this means learning to depersonalize 
and detach oneself from his own favorite problems, predilections, and 
prejudices only so that he may subject himself to those of his professors. 
Once iniiide the classroom door, he cedes to the professor the right not 
only to provide guidance toward the right answers, but even to decide which 
are the right questions. 
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University faculty tend to be a bookish lot. They tend to equate rtile- 
vant data with literary texts, and competence with bibliographical prowejjs. 
This confining of the definition of relevant data to printed books and 
articles (especially foreign language ones) tends to make a fetish out o : 
the current state of scholarship, leaving aside the question of the rela- 
tion of the current state of scholarship to the human situation. 

The sensitive professor is torn between the questicms and answers 
being dealt with in the classroom and those actually being struggled wit i 
in the world outside. 

Research versus Teaching 

Although the question of research is now well worn, it still merits 
further consideration. First-rate universities insist upon maintaining a 
vital relationship between research and teaching. But these two activities 
now imply an in-depth conflict when translated from abstract doctrine tc 
practice in the real world. The conflict can be seen by looking at the two 
competing constituencies to which the faculty member must answer — consti- 
tuencies which have very different expectations and criteria of acceptability. 
The two constituencies are the professional scholarly societies and the 
students. The situation is further complicated by the fact that both con- 
stituencies call for unqualified loyalty and represent values to which the 
teacher is firml]/" committed. It is not only an external conflict for 
allocation of his time but also a contest within himself. 

On the one side, the professional society is the scholarly peer grc-up 
of like--minded and similarly trained practitioners of each academic fie.'.d. 
By means of such an Establishment, standards are indeed maintained through 
meetings and publications, and "the present state of research** on each 
issue can be authoritatively identified. All discourse at these meetin^.s 
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(as in reputable journals and books) takes place on a single level of 
awarei\ess in a circle of scholars who accept each other's presuppositions 
and standards and characteristically refrain from challenging the basic 
assumptions upon which all are operating. The leaders of the professional 
society are the leaders in the field, being the same people who advise the 
most prestigious academic institutions and the most reputable publishing 
houses and journals as to worthy candidates for hi'.ring and worthy manu- 
scripts for publication. This mandarin system undeniably maintains high 
standards of technical excellence, but it also reenforces an exceedingly 
high degree of intellectual conformity. 

On the other side, there are the students V7ho demand good teaching 
and a genuine concern for themselves as individuals. They expect faculty 
to take the time to discuss outside of the classroom their intellectual 
and personal interests and problems. The young teacher usually finds that 
he has been better trained in his graduate program for producing scholarly 
articles in order to gain tenure, move upward, and become one of the top 
establishment people than in handling the daily grind of teaching and 
counseling students • 

The professor finds himself torn between the evaluation of his pro- 
fessional peer group, which evaluates his performance on the quantity anl 
quality of his research and publication, and the evaluation of students, 
who think most of their professors are lousy because they spend much of 
their time doing research and publishing rather than teaching. When the 
1 rofessor finds out that university administrators are listening carefully 
to both colleague and student evaluation for the purpose of making hiring 
and firing and/or promotion and tenure decisions, there should be little 
wonder that he tends to be seriously threatened by any kind of evaluation- 
colleague, student, or administrative. 



III,. 

The teacher finds it most uncomfortable to be caught in the middle of 
the tensions and conflicts presently inherent in his profession. The seen- 
ingly implacable demands from opposing sides in these various conflicts 
give rise to feelings of schizophrenia. He yearns for the calmness of 
spirit and absence of distraction needed for fruitful intellectual work, 
but he also aches for the world that needs changing. Combat weary, he is 
tempted to seek escape by settling into one camp or another, to settle 
down in a fixed position and quit hearing the others, to stay out of the 
crossfire as much as possible. 

Yet it is of vital importance that this temptation of choosing in an 
either/or fashion be resisted. The possibility of healing the wounded 
enterprise of contemporary education in the universities demands that the 
conflict-situation in which the teacher finds himself must be suffered 
through and somehow resolved on a higher plane than most have been able to 
reach. Meanwhile, it remains to keep open — V7ithin the bounds of reason, 
conscience, and sanity — to all sides of a schizoid situation. The remain- 
ing part of this paper attempts to promote a partial healing of the educa- 
tional process by suggesting three methodological presuppositions which 
may be used to legitimate innovative teaching and to build bridges between 
conflicting interests of students and faculty members . All of these 
presuppositions imply less authoritarian modes of structuring and teachirg 
classes and a decisive movement toward self and peer-group learning and 
evaluation . 

The three presuppositions which can be used in an innovative teachirg 
program are as follows: (1) a broader conception of the nature and purpcse 
of liberal education; (2) a broader conception of knowledge and truth; ar d 
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(3) a broader understanding of the student in his totality as a psycho- 
somatic organism, 

A Broader Conception c liberal Education 
All of the problems of pedagogy relating to educational courses and 
programs ultimately rest on a broader decision concerning the nature and 
purpose of a liberal education. As a tentative, working definition, let 
me propose the follov/ing: a liberal education is an initiation both incic 
the specific subject matter of the trtiditional academic disciplines and 
into the mysteries of human existence. This recognition of the part 
played by education emphasizes the fact that cognitive reality — which is 
only one human good among others — may be monstrously destructive unless it 
exists in the context of moral and aesthetic sensibilities. The purpose 
of a liberal education is to help the student learn how to continue to 
learn as the main purpose of life. If learning is conceived of as creative 
change In the student *s thinking and behavior, education in this broadenec. 
sense can become an exhilarating, lifelong pursuit. To go on learning am. 
sharing knowledge with others may well be considered a purpose worthy of 
mankind , 

An essential part of the change in the thinking and behavior of the 
student induced by education is the formation of increasingly free agents 
who can make morally responsible decisions between alternative courses of 
action. Implicit in the very Idea of freedom is an inward commitment to 
truth. The student preparing for freedom must throw away the crutches of 
dependence on teachers and course outlines. The authority of the teacher 
must diminish proportionately as the student matures in the exercise of his 
freedom. 
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The view of the nature and purpose of a liberal education makes active 
student participation indispensible in the process both of planning and 
running their classes. Especially in higher-level undergraduate and in 
graduate courses, more and more classes should be largely self-taught by 
the students — both in terms of self-instruction and of participative 
education in peer groups. Students maturing in the exercise of their free- 
dom also have an increasing right to be evaluated by their peers and by 
themselves . 

When the primary responsibility of thought and action is thrown on 
the student, the teacher consciously risks manipulation and abuse of his 
trust. The student with his new-found freedom finds himself the victim of 
a divided or ambivalent will. He genuinely desires to have the freedom 
to choose the subject matter he investigates, and to have a greater role in 
determining how to study it. But freedom implies responsibility and in- 
volvement, and this means time, effort, and devotion to the subject matter. 
The student is > therefore, dividt-^d against himself. He genuinely desires 
freedom in the educational process, but he a!! so bates what this freedom 
implies and will make up any plausible excuse to avoid it. 

Nevertheless, the teacher must himself be free and secure enough to 
take the risk of promoting the active participation of students in planning 
and running classes. He must continue to act hopefully upon the unverified 
premise that '*there is good in every student.*' He may not get very far in 
his efforts, but he will more than likely find that his every effort is sub- 
stantially rewarded. 

A Broader Conception of Knowledge and Truth 
There needs to be an attack on the popular positivism or scientism and 
the philosophical rationalism which claim that scientific knowledge and 



logical conceptualization are the only truths that now exist or ever should 
have existed. This argument should not by any means be construed either 
as an attack against science and its technological application or as a 
revolt against h uma n rationality as such . There must be a new, broader, an 
more humane conception of knowledge and truth whilch will embrace the sen- 
sitivity of students for the present moment, the. r concern for moral values 
and their commitment to the unity of thought and action. 

Without denigrating or allowing the activist student to denigrate th- > 
human past and the accumulated wisdom of the race , there is a need for th i 
university to devote more of its attention to the present and the future 
than it ever has before. Given the present mind-boggling rate of techno- 
logical change with all of its social and cultural consequences, and 
given the staggering knowledge-explosion which is now upon us, the modern 
educator and the student have much to learn together and irom each other. 
There are, in fact, many present realities of which professors are ignorant 
and with which the students are in immediate contact in their daily lives. 
Furthermore, because of the uncertain future into which they are sending 
their students, teachers must be concerned with equipping, them with a 
functional learning that can adapt itself to nev; situations and problems. 
Teachers must help their students to think in a manner that will allow 
them to discover their own answers to questions rather than encouraging 
them to accept ready-made answers. One of the best ways to promote this 
is for the teacher to master the Socratic method of asking the right 
questions at the proper^ time and place in such a way that students are 
helped to express what they have already experienced but cannot quite 
bring to consciousness and articulate. 
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Thus, recognlZ3/ng that education has formerly been too ir.uch oriented 
toward the past, the innovative teacher must be capable of achieving and 
propagating an openness of mind to new breakthroughs and a general readiness 
for originality and spontaneity — for example, in the creation and develop- 
ment of new methods and tools for research and analysis of elusive contem- 
porary and future movements, events, and trends. Such an openness of mind 
requires not only moral courage but mental and physical stamina as well. 
For in studying present or future trends, the usual bibliographical sources 
are scanty at best and often non-existent. One is on one*s own to scrounge 
around for materials, interview people, watch television, read newspapers, 
keep track of movies, listen to popular rock albums, and remain current with 
ephemeral pop-culture items which are seldom if ever bought or saved by 
libraries. 

A Broader Understanding of the Studant as a Psychosomatic Organism 
Finally, innovative teaching will be expedited and much of the dessica- 
tion of our universities and our culture can be overcome if the student is 
both thought of and treated in his totality as a psychosomatic organism 
who has a body, unconscious drives, aesthetic sensibilities, and moral 
sensitivity, as well as the capacity to think and talk. Any educational 
process which reduces nature, discovery, and learning to a dull affair — 
scentless, colorless, merely the hurrying- through of a certain body of 
endless, meaningless material — is lethal. It is as immoral to bore a 
student as it is to abuse him physically. 

The lecture method, while still useful for limited purposes, must in- 
evitably give way to a whole new battery of teaching techniques, ranging 
from role playing and playing games to interactive, computeT -mediated 
classes and the immersion of students in ^'contrived experiences.** Experi- 
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ential prograiraning methods, utilizing a multi-media approach and drawn fror 
recreation, entertainment > and industry, will more and more be supplanting 
the familiar and usually brain-draining lecture. Educators have always 
known that learning and life itself are maximal where play and work coincic 
The innovative teacher must try to create the kind of learning environment 
where this situation may either happen or be recovered. Then learning may 
once again become delightful, serious fun. 
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RATIONALE FOR BUILDING A TAXONO^tY OF CLASSROOM LEARNING SKILLS 

David A. Santoro* 

There is increasing evidence today that educational practice has been 
weighed in the balance and found wanting. Some of the factors which have 
contributed to this judgment are: (1) the failure of educators and theo- 
rists to determir.iL what are the lawful and relevant determinants to lean- 
ing in a university setting, (2) the weaknesses of traditional psycho- 
diagnostic methods in providJ.ag adequate assessment of relevant behavioral 
phenomena, (3) our earlie?' inability to provide a repertory of prescript- 
tive interventions designed to effect a strategy for coping with learninf; 
problems, and (4) our failure to develop relevant criteria of effective 
human behavior and the means wherewith to assess our approximations to 
these criteria. In briefer terms, our teaching practice has been limite'i 
by an inadequate conception of What is school learning? How can wa assess 
It? What can be done about promoting it? and How can we determine whet ler 
We have been successful or not? 

The purposes of this paper are three-fold. The first is to discuss 
the development of educational practices within the context of the above 
central questions as they relate to- the development of educational models. 
The second is to compare some specific approaches to educational practice 
within the context of these same questions, and the third is to provide an 
overall rationale for building a taxonomy of classroom learning skills. 

Nearly all great philosophers, dictators, social reformers and ex- 
ponents of revolutionary change have concurred in their conviction that the 
educational system of a people is a primary control mechanism for the de- 
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velopment of specific skills and attitudes as well as behaviors on the part 
of children. As a result, education has been viewed as a primary mechanisn 
for cultural transmission. 

The problem of \'Jhat constitutes school learning has then been related 
directly to the pervasive and pivotal issues which confront society at any 
given time. The application of these philosophical or methodological ideas 
is strictly limited by the potential of teachers and administrators to 
initiate change in the fabric of society. Because philosophical and method- 
ological ideas can be more easily expressed than implemented, the process :.s 
slow and sometimes halting. 

What Constitutes Learning? 
The question of what constitutes learning has been answered by three 
different raodels within the history of American education. Most of these 
models still remain in some modified vigor or form within the universities. 
These three models may be identified as: (1) the mental-discipline model, 
(2) the philosophy of experimentalism identified with John Dewey, and (3) 
the mental-hygiene approach basically derived from psychoanalytic and medical 
models of personality adjustment. To a large' extent, these conflicting models 
of teaching and learning have variously conceived of the teacher as a content- 
oriented purveyor of knowledge (mental-discipline model), a guide for the 
progressive evolution of self -discovery experiences (experimentalism) , or as 
a kind of junior psychotherapist (mental-hygiene approach). They have viewed 
the students^ implicitly or explicitly, as terminal objects to be programmed 
with knowledge, as mechanisms for exploring the environment or as individuals 
whose mental and physical health are essentially jeopardized by the aver si ve 
environment of civilization. 
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Few of these approaches remain in pure form in the university system 
today. And yet teachers do believe in their role as a cognitive purveyor 
of knowledge (mental discipline), most believe that self -^discovery and 
problem-solving are important social skills to be learned in education 
(experimentalism) , and nearly all acknowledge that personal adjustment and 
stability are related to adequate learning (mental hygiene) . 

As each of these systems pervaded universities defining learning and 
the teaching process in differential ways, so the second question of How 
can We assess learning was answered difft'rently by each of these approach'iS . 
Classical humanistic learning assessed learning primarily in terms of cog- 
nitive growth and development joined to verbal abilities. This can be 
readily seen in terms of the assessment devices used. Oral examinations, 
essay examinations, the ability to think on one's leet and defend ideas 
were all considered methods of evaluating the product of education. 
Theses, dissertations, term papers, and passing of extensive examinations 
also provide indices. But for the most part, these apnroaches were sub- 
jectively evaluated by the master teacher, the oral committee or colleagues. 

In the philosophy of experimentalism, much more emphasis was placed 
on a process-orientation involving problem-solving skills primarily identi- 
fied with social goals. However, since thi can be less readily assessed than 
the methods used by classical humanistic approach, and because of the con- 
fluence of social philosophy with experimentalism in the thinking of Dewey 
and others, a need was felt for objective evaluation. This nee<. was filled 
through group-testing procedures. Thus, group testing as an objective 
method of comparing individuals in relation to group norms was conr-iderec 
to be a more inportant method of evaluation characterized by the well-kncwn 
biases of experimentalism in philosophy. 



-34- 



Within the mental-hygiene approach, the methods became once again more 
individualistic with the development of diagnosis, prognosis, and treatment 
procedures incorporated within the frame of reference of education. The 
teacher as a therapist was more concerned with providing a wholesome en- 
vironment for the development of Well-adjusted children, than in either cf 
the other major approaches. 

Certainly, the goals of the approaches and the processes used to evcilu 
ate educational change were then related to curriculum objectives. Curr:.~ 
culum objectives should focus on the answer to the question, " What can be; 
done?" The approach of classical humanism v/as primarily one of systematic 
organization providing implicitly or explicitly the undergirding framework 
or scaffolding (as.Ausubel in recent times has referred to it) for cogni- 
tive concept formation. Thus, knowledge could be divided into specific 
areas with sub-~areas and specialities. These sub-areas could then be 
studied, memorized, learned in a variety of techniques. The approach of 
experimentalism focused on the teaching unit with social goals and demo- 
cratic values providing much of the curriculum empl:.?.sis. Finally, the 
mental-hygiene approach was much less precise in terms of curriculum, 
drawing primarily from the other areas but specifying certain kinds of 
game such as socio-drama as curriculum V' hides . 

Since each of these particular models did have a philosophical base 
for its approach which could be identified as: (1) classical realism, 
(2) experimental pragmatism, and (3) positivistic relativism, they did 
more or less efficiently prescribe the parameters of the learning process, 
the methods of attack, the goals for the process, and the curriculum 
vehicle to be used. In addition, however, they did attempt to formulate 
an effective criterion of the educational process. They sought to evalu- 
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ate their efficiency against criteria such as the mental-disciplined human- 
ist, the truly democratic man, or the well-adjusted personality. Since 
these ideas are only constructs, any attempt at the assessment of measured 
progress toward these goals was bound to suffer from a lack of specificity. 
Moreover, each of these ideological constructs was applied to the specific 
power structures of the school, and the interactive effect of all three 
models was applied differentially within the specific system. 

It is apparent that education has been forced to cope with a variety 
of models of learning* Operationally or functionally, this has tended to 
mean that the teacher has been orientated in a curriculum program somehow; 
designed to accomplish a job in the universities wherein the primary 
phenomena dealt with are variously interpreted, the methods used to cope 
with these phenomena subjectively related to the shifting phenomena, and 
the criteria of effectiveness for the most part not ascertained. 

Although the existing educational models and practices have been 
effective in varying degrees, the real efficacy of the teacher has been 
hampered : (1) by a variety of conflicting models of education based on 
confused notions as to the primary phenomena of learning involved, as well 
as the goals, methods, and criteria of evaluation derived from several 
different disciplines and philosophical bases; (2) by inadequately concep- 
tualized criteria for evaluating results of practice both within and 
between these several approaches; (3) by differential training programs 
which have attempted to meet, compromise with or otherwise synthesize 
disparate elements and foci into unified training objectives; and (4) by 
an inadequate philosophical base as well as a x<reak scientific methodolo:5y . 
In addition to these problems, the well-known recent emphases on disadV'in- 
taged children and the crash programs of the federal government (very often 
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hastily implemented on the basis of suddenly available funding) , inade- 
quately conceptualized theoretical or evaluative bases, and limited per- 
sonnel, have forced educators to operate generally as people who subjec- 
tively try to fit various tools and methods from their repertory to the 
tentative and expedient goals of the school in a pragmatic or eclectic 
manner • 

Social Learning Model: Characteristics 

If education is to provide a series of services to the university com- 
munity in a comprehensive manner, it is imperative that somehow a logical 
model be developed. It is the assumption of the writer that at least a 
semi-scientific model can be developed utilizing the principles of logic 
and £;cience to serve as guidelincis . 

The logical requirements of a comprehensive model for teacher train- 
ing are five-fold: (1) the phenomena of the model should, in part, be 
empirically observable, definable and classifiable, (2) the interpreta- 
tion of the phenomena should be non-eclectic, i.e., describable in termin- 
ology corresponding as accurately as possible to the simplistic empirical 
fact, (3) the ordering of the phenomena should be logically consistent 
and parsimonious yielding adequate discriminatory judgments, (4) the modiil 
should possess power functions for assessment and evaluation of differen- 
tial phenomena within the model, and (5) the model should be philoso- 
phically sound and compatible with the scientific approach. These logi- 
cal requirements will now be discussed in fuller detail as they apply to 
a social learning model of educational practice. 

It is the contention of the writer tha^ social learuin^, theor^^ pro- 
vides, in part, a comprehensive, logical and scientific basis for educa- 
tional practice. Specifically, social learning theory*. (1) provides a 
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comprehensive philosophically based and scientifically viable framework for 
describing, analyzing, and treating the phenomena involved, (2) is suscep- 
tible to scientific investigation, through the determination of adequate 
methods of assessment and evaluation of phenomena, together with a coherent 
testable set of treatment strategies, (3) provides the educator with a rcle 
consonant with the nature of the phenomena he works with, and (4) provides 
a rationale and methodology adequate for determining criteria of efficient 
operation, i.e., success or failure. In short, social learning theory pro- 
vides a comprehensive, logical and integrated model of educational pract:.ce 
for describing, assessing, and treating basic learning phenomena. 

Social learning theory can be considered as a body of scientific 
knowledge derived from studies of culture, the environmental press, skil'- 
acquisition, social psychology, and behavioral learning and psychotherapy. 

The Empirical Phenomena of School Learning 
One of the first tasks of any scientific endeavor is to define the 
basic phenomena which will serve as the separate focus for investigation. 
By way of consideration, one may look at either global constructs which lave 
been used to refer to learning, or very specific concepts. Examples of ihe 
former are learning as an art wher -^-^n learning was considered a product Df 
personality, ego development, motivation, mental discipline, or problem- 
solving. These global constructs represent humanistic constructs, interven- 
ing variables, or an array cf complex skills. In short, they would appear 
to be the products of learning rather than the descriptive characteristics 
of learning itself. In the same way, the intensive animal studies of learn-- 
ing with identification of the stimulus-response model appear to be clear 
reductionism to an overly simplistic and atomistic term. Thus, one defini- 
tion of the phenomena involved is apparently too global for precision in 
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distinction and classification and the other approach is too minute. It is 
important that we should be able to determine the beauties of a sunset over 
the mountains and trees, and it is also important that we be able to zero 
in on the nature of a leaf in a particular tree. This may be called per- 
spective. But in classroom learning if we are to deal readily with phenoirena 
that can be mrnipulated and controlled, we must find an intermediate posi- 
tion which is sufficiently specific to allow for definition, but not so 
minute that it cannot be utilized meaningfully. 

Such a construct can be found in the notion of skill . An empirical 
evaluation of the nature of classroom learning, plus the evaluation of a 
considerable amount of research literature in the specific areas of human 
learning and environmental *'press", would appear to support the definition 
here that the skill concept defined as a functional ability to perform a 

.A 

specific task is the legitimate behavioral phenomenon of classroom learni- ig^ * 
Recent research and writing in education has suggested rather obliqui^ly 
that the teaching-learning situation is moving toward the enhancement of 
task-oriented learning (Bower, 1964; Bordon, 1964; Bordon and Bennett, 1967). 
Moreover, the specific research of Gagne in the description of conditions 
of learning (1965) , the cognitive emphasis of Ausubel (1965) and Bruner 
(1966), and the considerable research studies of the behavioral learning 
group found in Bijou and Baer (1961), Patterson (1967), Ferster (1962), 
Williams (1959), Lazarus (1965), Bandura and Walters (1963) and Hewett (1968) 
have provided the research background supportive of this definition of class- 
room learning phenomena. 

Each of these researchers in their own way has helped to provide a 
research background which would support the notion of skill acquisition as 
the legitimate focus of the educational enterprise. For example, Gagne 
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(1970) has provided a sequential learning model which takes into considera- 
tion the step-by-step process of learning through signal and stimulus- 
response learning to chaining, verbal association and subsequent multiple 
discrimination and generalization. Taylor (1962) and Berlyne (1960) have 
identified the fact that different sensory modalities are involved in 
learning, Ausubel (1965) and Bruner (1966) have suggested that a different 
type of learning is necessary for cognitive association, concept formation 
and receptor learning. Ausubel particularly has ejnphasized the need for 
what he calls advanced organizers or the cognitive scaffolding which allows 
for the systematic expansion of verbal concepts. The behavior modif Lcation 
school, which has involved the experimental manipulation of children's 
behavior and specialized studies with hyperactive, autistic, tantrum-behavior 
and phobic children, though gemerally limited to experimental units outside 
the schools, has provided considerable research evidence regarding the 
efficacy of such techniques (Grossberg lv:'6A) . Bandura and Walters (1963) , 
though not again specifically addressing themselves to the cl^.ssroom 
setting and draving heavily on social psychology, have indicated the 
strength of such social learning techniques as imitation, vicarious experi- 
encing, modeling, and shaping of behavior. Skinner (1968) has also sug- 
gested than teachers could obtain far greater results if they could define 
the kinds of behaviors they wish to obtain. Hewett (1968) , in the appli- 
cation of much of this research and working in the specific context of 
educationally-handicapped children, has developed what he calls the engineered 
classroom In which the educational task-orientation learning system xs bro- 
ken down. Into seven stages or steps. These he conceives to be attention, 
response , order , exploration, social-skill acquisition , mastery, and 
achievement. He has found tha^^ children can be sequentially programmed 
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through these stages, and that in point of • fact it is extremely important 
that children learn the earlier stages before they proceed to the more 
advanced ones. 

These research studies clearly point out that the concept of skill 
is a legitimate base for building a taxonomy of classroom learning. 

The second area of research findings focuses on the question of 
learning contingencies. Given structural intactness, hov can learning be 
augmented, corrected, controlled and enhanced? Research from the area of 
measurement of the environmental "press" provides another key to skill- 
a.cquisition rate. Measurement of the environmental "press" has stemmed 
from an effort to determine more adequate predictors and criteria of. 
effective collegiate behavior. The concept developed from the research 
studies of Pace and Stern (1958), Thistlethwaite (1960), Holland (1959), 
and Astin {1965). This concept has related to the measurement of the 
means whereby the environment shapes and molds the behavior of the 
individuals who live within it. In a series of studies (Barclay, 1966) 
the writer has systematically explored the nature of environmental "press^' 
in the secondary and elementary curriculum. The studies by the writer 
have provided evidence that peer ratings and teacher thrust constitute 
the two ma.lor criterion sources of effective human behavior in the 
classroom. These studies corroborate the research of others such as 
Backman and Secord (1962), Backman and Pierce (1963), and Patterson 

(1967). 

Thus, it would appear that any attempt to assess social behavior in 
the classroom must take into consideration the cultural criteria of 
effective behavior which are set and sustained by the peer group and the 
teacher, sometimes in conjimction with each other and more often in some 
opposition to each. othe^^. 
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What all of this research leads to is a definition of classroom 
learning in terras of differential rate of skill acquisition within a social 
context. The following statements may summarize Tvhat appears to emerge 
as the fundamental framework for describing classroom learning. This 
fraEiework takes into consideration both the fundamental set of behavioral 
responses issued by the subjects of learning (skill acquisition) and the 
methods whereby such responses are augmented, controlled and developed, 

1. Learning may be characterized in the classroom as differential 
skill acquisition, subject to structural and environmental 
contingencies • 

2. There is a hlcir^.rchy of skill acquisition extending from 
simple to complex manifestations. 

3. Learning skills may be tentatively classified within the 
major categories of perceptual-motor skills, social skills, 
and cognitive concept-formation skills. 

4. The rate of skill acquisition in the individual may be 
considered a dependent variable related functionally to 
structural endowment and environmental programming as 
independent variables • 

5. Constructs such as attitudes, emotional states, affects 
and motivation are by-products of both interpersonal and 
environmental shaping and are related specifically to habits 
of skills acquired. 

6. Classroom learning is task-oriented and systematically shaped 
by two major criterion sources (i.e., peers and teachers) who 
act as de facto agents of the cultural transmission. 

This approach to classroom learning then is characterized by the view 

of classroom learning phenomena as: (1) a series of task* jriented skills, 

(2) requiring differential programming in relationship to structural 

limitations and goal-setting of criteria, (3) shaped and influenced by 

immediate criterion sources ef effective behavior identified as primary 

c.h:;.age of influence agents in the le.^rning process, i.e., peers, teachers; 

and curriculum materials. 
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RECENT RESEARCH IN LEARNING BEHAVIOR: 
SOME IMPLICATIONS FOR COLLEGE TEACHING 

Dale M. Brethower^ 

Research on Teaching 

A recent review of research ovt college teaching has the intriguing 
title The Teaching-Learning Paradox , The paradox, as I understand it, 
is that: on tho one hand we are sure that teaching method, class size, 
and teaching style are important but on the other hand the research eviderce 
fails to show that such things have much influence on how much students 
learn. Differences in teaching don't seem to produce differer.es in 
learning. For example, a major conclusion of the review is that the 
research on class size offers no clear support for the belief in the 
superiority of small classes. 

To put this review in perspective, let me talk about a paper oae miglit 
write called "The Rain Dance-Rain Paradox*'. The findings in the paper mij;ht 
be that variations in details of the dance, while passionately believed b^' 
the dancers to be crucial, would tend not to correlate with variations in 
rainfall. There would be some promising findings in the paper. For 
example, there would be consistent differences in rainfall in different 
areas and surely at least some of the differences should be attributable 
to differences in the rain dances. It might be embarrassing to discover 
that in areas of heaviest rainfall t?iere seems to be the least raindancin,; 
but that could be explained by indicating that the features of the rain 
dance were well represented in the day to day behavior of the population. 
With such community support no special dancing is required. 

The similarities between the rain dance-rain paradox and the 
teaching-learning paradox are perhaps superficial. As a professional 
Q 5^Assistant Professor oi: Psychology slU The Cleveland State University 
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teacher I certainly like to think they are; however some parallels cause 
nagging doubts. For example, just as there is the most rain dancing where 
there is the least rain, the most teaching^* occurs in special seducation 
classes and remedial classes which are also locales of minimal learning. 
And, as a graduate student, I often learned most when not interrupted by 
the graduate faculty. 

Of course, I'm not suggesting that learning is as uninfluenced by 
teaching as rain is by rain dancing. I am willing to argue that a ct of 
our teaching behavior is superstition, hut wbni: I am really assertin:^ is 
that much of the research on teaching deals with aspects of teaching loosely 
related to crucial aspects of the learning process. Consequently, the valje 
of the research is very much reduced and the results are very difficult to 
interpret . 

The task of interpreting the research on teaching is similar to the 
task a chemist would have in reading a book reporting extensive research 
on some set of chemical reactions but which, inexplicably, neglected to 
mention an important variable, for example, temperature. The chemist 
could read the experiments, make some plausible guesses about what certain 
of the temperatures must have been, interpret data in light of those guesses, 
modify his guesses, and tease quite a bit of information out of the studies. 
The studies could be valuable without being well done or w. xl reported; 
if interpreted carefully by someone who knew chemistry. 

As someone who knows something about research mr hodology and about 
the learning process, let me offer some interpretations of research and 
college-level teaching. 

My first point is relevant to the conclusion of The Teaching-Learning 
Paradox review by Dub in and Taveggia: the evidence fails to support the 
superiority of small classes over large classes. Assuming the validity of 
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the conclusion, what does it mean? Exactly what it says and nothing more. 

The evidence does not show that large classes are as good as small 
classes. The several research studies test three hypotheses; (1) The 
Null Hypothesis that there is no difference in effectiveness between large 
and small classes, (2) Alternate hypothesis A, that small classes are 
superior to large classes and (3) Alternate hypothesis B, that large classes 
are superior to small classes. 

Some studies reject the null hypothesis and show small classes to be 
superior; other studies show large classes to be superior. The bulk of 
the studies fail to show differences. 

The statistical techniques employed can show differences but thay 
cannot prove equality. We v:*.annot prove the null hypothesis. All we can 
do is say that our measurement procedure was not precise enough to detect 
any differencec; that might exit't. The research does not prove the superiority 
of small classes; however, it wovild be a serious logical error to conclude 
that it shows large classes to be as good as small classes. We can restate 
and amplify the Dub in and Taveggia conclusion: 

(1) Some small classes are superior to some large classes. 

(2) Some large classes are superior to some small classes. 

(3) Class size alone does not determine quality. 

A second major point regarding the Dubin-Taveggia review made by 
McKeachie in a review of research on college teaching published in 1971. 
"The Dubin and Taveggia review deals only with the effects of teaching oa 
course examinations. The results presented in this (McKeachie 's) paper 
substantially support their conclusion that so far as performance on covrse 
examinations is concerned, there is no strong basis for preferring one 
teaching method over another. When one asks, however, whether knowledge 
^ (1) is remembered after the final examination, (2) can be applied to new 
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problems, or (3) is related to attitudes and motives, we find that class 
size and teaching method do make a difference. "Analysis of research sug- 
gests that the importance of size depends upon educational goals. In gen- 
erals large classes are simply not as effective as small classes for re- 
tention, critical thinking, and attitude change." 

McKeachie suggests that, in any course with mialtiple objectives, each 
objective should be stated and different methods be used, at different 
times. He's not arguing for variety in methods merely for the sake of 
variety or to alleviate boredom. He's recommending careful matching of 
specific methods to specific objectives. But he does this at the end of 
the review, suggesting that it can be done in the future when we know mors. 
Not everjrthing is left for the future, however. McKeachie offers some very 
useful suggestions, supported "by research, which we can use to begin or tD 
fTirther our efforts to match methods to objectives. I wo\ild heartily 
recommend the review to anyone who is serious about doing a competent job 
of college-level teaching. It will offer some ideas for improvement's and 
help to confirm the wisdom of some of the attempts already made. And, 
perhaps you will find one or two of the studies intriguing enough to dig 
out and read in the original. 

Research on Learning 

Let me turn now to research on the learning process and examine impli- 
cations it has for teaching. How much do we know about the learning process? 
It is fashionable for psychologists, when faced with such a question, to say 
something like this: ''The scientific study of learning is really quite rew. 
We have learned a lot, of course, but much cf the work has been done stucying 
rather simpl*^ kinds of learningr ^toen it comes right do'vm to it, we do rot 
know very much tha.t would be of practical use to teachers, particularly et 
the college level." I personally believe that any psychologist who makes 



such statements is speaking the truth. However there is a grammatical error 
in the last sentence. When the psychologist says "We do not know very much,.," 
he is using first person plural where he should use firs: oerson singular. 
If a psychologist — even an eminent researcher in the f Id of human learn- 
ing — says "I do not know very much..." then I feel it good of him to 
confess his ignorance but I do not recognize his authority to speak for me . 
In all humility, I number myself among the hundreds of psychologists and 
educators who know quite a lot about the learning process that is of very 
practical utility. 

In fact, I would assert that we know enough to revolutionize education 
if the knowledge were applied to the improvement of education. What, then, 
is that knowledge? And is it well-documented with solid empirical evidence 
or is it a collection of opinion statements that psychologists argue abou:: 
among themselves? 

These criteria were used in selecting the parts of research on learn -ng 
to describe today: (1) The test of time - Each set of findings appeared "irst 
in the literature prior to 1929; (2) The test of continued investigatioi - 
Each set of findings has been replicated, further investigated, and supported 
by more recent research?. (3) The test of relevance Each set of findings 
can be related to specific instructional procedures; (4) The test of comp Lete- 
ness - Taken together the findings can support a rather comprehensive set 
of guidelines for college-level teaching. 

The first of six conclusions from the research literature states 
"As soon as learning stops, forgetting begins." One might ask "How soon 
is 'as soon as'?" and "What do you mean by forgetting?" By forgetting I 
mean falling off in the measure of learned perf onnance , e.g. performance on 
a test. By "as soon as" I mean by the time the experimenter plots the first 
point on his retention curve. First points have been plotted within minutes. 
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within hours, within days, within weeks, and v;ithin inonths after the mastery 
test. The generalization holds across the range of times (Woodv;orth and 
Schlossberg, 1956). 

The second part of the conclusion regarding retention is that "If 
amount learned is defined as the difference between pre-test and post-test 
scores, the ciraount forgotten is approximately equal to the amount learned 
unless the material is reviewed during the post-test retention-test inteirval." 
In other words, the student rhetorical question "The more you study the more 
you know, the more you know the more you can forget, the more you can forget 
the more you do forget, the more you forget the less you know. So why study'''' 
has some merit. One forgets most of what one learns. The amount forgotten 
is approximately equal to the amount learned. 

But what is meant by "approximately equal"? In a variety of laboratory 
studies^ using a variety of material learned, and a variety of retention 
measures it is uncommon for retention to remain as high as 50% for very long 
and quite common for it to drop below 20%. And, in ail of the retention 
curves. X the last point plotted is the lowest, indicating that retention is 
still dropping. 

Most of the laboratory studies assume a zero as the pre-test score, 
which means that the data presented, if any thin^^ , over-estimate retention. 
Retention data on college-level courses is very rare and is ordinarily not 
collected in such a way that makes more than the wildest guesses possible 
about how much is retained. Even so, to estimate that students retain 50% of 
what ,they learn in a coursiB for more than a few months requires mere optimise 
(or possibly more ignorance) than I have been able to muster. Clearly, the 
burden of proof is on the professor who claims his students retain large 
portions of what they learn in his course. 

The second of the six conclusions from research on learning is this: 
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Transfer of training (i.e. the ability to use what is learned later on or 
in a different setting) is a function of similarity between training condi- 
tions and transfer conditions. Large differences in setting, response 
requirements, aud/or incentiveb result in little transfer. 

There are several variants of transf er-of-training studies all revolving 
around the general question, *'If training occur"; under one set of conditions, 
does the learned performance transfer to other tsets of conditions?" Early 
research made the answer very clear: Not much transfer occurs. 

To substantiate the point that little transfer occurs all that^s really 
necessary to do is point out — as several researchers have — that retention 
studies can be considered as special cases of transfer of training studies. 
Lack of retention is one instance of a failure of transfer of training. Mary 
other instances could be cited. So clear were the findings that transfer dees 
not just happen, and so clear were the findings that retention is minimal, 
that mL:ch of the research has dealt with what is essentially a teaching 
probl^im, i.e. how can one increase retention and transfer? 

rhe answer to that question appears to be summarized by one simple guic.e- 
line: Simulate transfer conditions during training and ^iliminate the tiiine 
interval by timely teaching or by continued review or practice. 

Please do not be misled by my use of the historical term "training", "n 
this context the word "learning" could be substituted for the word "training;". 

The third conclusion from research on learning is that the learning 
skills of students are major determinants of how much is learned. There ar<j 
wide variations in learning Stcills and abilities; however, students can acquire 
learning skills which enable them to perform well above their predicted abilities. 

Students' learning skills are the skills they use in learning: How th-ay 
study as well as how much they can get themselves to study or how much their 
teacher can coerce, con, cr kindle the desire in them to study. 
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It is quite obvious that how one studies influences how much he learns. 
For examplv^ Gates (1917) did a very simple experiment in which some students 
learned material by repeated readings of material, whereas other groups 
spent 1/5, 2/5, 3/5, and 4/5 of the study time reciting the material. The 
result was clear: The more time spent in recitation the more they learned. 

That the skills students use influence how much they learn is probably 
"intuitively obvious" to most teachers who have thought about it. It is not 
as obvious that students can be taught skills that enable them to learn more 
efficiently. Nor is it obvious that the acquisition of such skills can 
enable them to perform above their predicted abiliJ:ies. 

The conclusion that the learning skills used by students are major 
determinants of how much they learn rests on a solid foundation of research, 
but in adding the conclusion that students can acquire learning skills which 
enable them to perform above their predicted abilities, I am venturing into 
an area where people Cc.n reasonably question the adequacy of the evidence » 
Rohwer (1971) reviews some rather substantial supporting evidence. However, 
the evidence which convinced me was data collected in part to evaluate the 
effectiveness of reading improvement — learning skills classes at the University 
of Michigan. Smith and Wood (1959) report data showing that students completing 
the classes out-performed comparable students in terms of grade-point 
averages and ability to remain in school. Unpublished evaluation data 
(Brethower, 1970-71) for the years 1969-70 and 1970-71 also showed higher 
grade-point averages among students who completed the course. One group 
of students, designated as high-risk on the bases of SAT scores, had higher 
grades than would he predicted from their SAT scores. During 1970-71, 
in fact, the grade-point average distribution for the high-risk group was 
skewed slightly in the direction that would be predicted for a high-potential 
group. 
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The fourth conclusion from research is that a major determinant of what 
is learned (as opposed to how much) is the as^iessment procedure employed. 
Students instructed in what they are to learn and in how they are to be tested 
perform better than students not so instructed, Watson (1960) must be given 
credit for this conclusion. He pointed out that assessment procedures 
influence what students learn. The point, is almost too obvious to be researched. 

The fifth conclusion from research is that knowledge of results facilitates 
learning. As Bilodeau (1966) points out in a rather extensive review, knowledge 
of results has been shown to facilitate learning of an extremely wide variety 
of things from simple motor tasks to complex verbal knowledge. Not only does 
it facilitate learning but also it has been shown that learned performance 
tends to deteriorate in the absence of knowledge of res^.^lts. 

The sixth conclusion, that many concrete examples are necessary for 
concept formation, is a finding replicated in almost every concept-formation 
experiment ever performed (Razik^, 1971). Attempts to teach concepts without: 
examples are likely to end in failure, or in the subjects constructing the 
necessary examples, or in subjects who learn verbalizations about concepts 
but when confronted with examples demonstrate that they have not really learned 
the concepts. 

To conclude that it is possible both examples and non-examples 
are essential for concept formation — and that is my conclusion — is to 
venture onto shaky ground. But the basic parts of the six stated conclusions 
are very well founded and are adequate to support the six guidelines for 
instructional design which follow. 

The first guideline is quite straight forward. "Objectives should be 
clearly stated; students should be told in ';^:f^fal ways what they are to learn.*' 
This guideline follows directly from the fourth conclusion from research, 
namely that instructing students in what they are to learn improves their 
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perf ormance . The guideline also helps make it possible for students to 

adjust their study techniques in accordance with instructional objectives. 

For example, if students are told that they are to learn hew to sort out key 

points from trivia and trivia from subordinate points they can direct 

their efforts in that direction rather than wasting effort ^nemorizing trivia. 

Psy hing out the prof, searching for the structure of the subject matter. 

and learning specific concepts are separable objectives which require different 

sets of study behaviors. 

The first guideline says that objectives should be communicated to 
students; the second says "Testing-evaluation procedures should be used which 
assess attainment of the objectives." To quote Watson (1960) "If there is 
a discrepancy between the real objectives and the tests used to measure 
achievement, the latter becomes the main influence upon choice of subject 
matter and method," In other words, if your objectives speak in lofty 
terms about "understanding basic concepts" and "developing critical thinking" 
but you test ability to write down or recognize facts the students will 
learn to do the latter. 

Your assessment or testing procedures must ir volve measuriro, the 
actual performance specified by the objectives. If they do not, then the 
assessment procedures must be validated in order to be meaningful. Otherwise 
the procedures will not only fail as measuring devices but Chey will also 
actually detract from your objectives. If the testing procedures are 
adequate, on the other hand, they will facilitate achievement of objectives. 

The !:hird guideline states "study procedvires should be specified 
which encourage students to engage in study behaviors appropriate to the 
material taught." Since what students learn and how much they learn depend 
so much on their study techniques ic follows that this should bo an important 
area of concern to the instructor. I am operating under the assumption, of 
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course, that one of the instructor's goals is to maximize attainment of 
course objectives for as large a percentage of students as possible. 

The guideline is difficult to follow, primarily, it seems to me, 
because most instruction students have had encourages rote memorization. 
Not by design surely, but by failure to follow the first two guidelines 
regarding objectives and assessment procedures. It is difficult to get 
students to break out of a study style that has paid off for them in the past. 
But if the instructor has gone beyond rote memorization in his own grasp of 
the material, surely he could offer some assistance to students in this 
extremely important area, 

The fourth guideline states that "different instructional methods 
should be used for different objectives". In gencial, the method of choic'3 
is one in which student participation is maximized and in which students 
engage in clearly specified approximations to the behavior specified by the 
objectives. This follows directly from conclusions regarding transfer of 
training, the importance of study procedures, and to a lesser extent the 
importance of knowledge of results. 

The fifth guideline states "instructional materials should include 
inii:r -examples and non-examples of all the major concepts to be taught in 
t;.. course," The reason for the guideline is simple: If it is not followed 
the concepts will not be learned, except by studen'»:s who have already 
experienced the missing examples or who construct them or who find them in 
other materials or in other sections of the course. 

The guideline calls for both examples and non-examples which is 
perfectly safe since examples of one concept can usually function as non- 
examples of related concepts. 

The sir.th guideline states "courses should be designed so that studenis 
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can obtain frequent and immediate feedback on their attempts to learn. 
Feedback should be available while they are study ja^ " This follows from tho. 
fact that feedback (knowledge of results) facilitates learning and the 
presumption that the proper function of studying is to learn. 

The six conclusions are not the only well founded conclusions from the 
research on learning. Nor are the six guidelines for instruction the only 
clearly supported guidelines. But these are enough, I think, to provide both 
guidance and challenge to us in improving our courses. As our instruction 
comes closer to following the guidelines we will be able to see that it is 
better. If all our ins true followed all the guidelines* education would 

be revolutionized. And if our wisdom were great enough so that our instructional 
objectives were good, it would be a revolution for the better. 
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PART TWO 

STRATEGIES AND TACTICS IN PRACTICE 

It is one thing to speak in generalities about how teaching can or 
cannot be improved. It is another to begin to trade classroom experiences, 
to talk with other colleagues about how this or that instructional tactic 
did or did ^.ot work in prar-tice* Both parts of the polylogue about teaching 
are valuable to be sure. Who, for example, would deny the importance of 
defining the parameters of instructional excellence? Such definitions 
establish our commonality as teachers, whatever our discipline. Still, 
from the individual faculty member's perspective, talking in specifics is 
often more useful. The more ideas we exchange, the more we become aware 
that we face the same problems, and can respond appropriately in similar 
ways. In fact, there exists an entire catalogue of valid techniques fro.n 
which we may choose. 

The fifteen papers in this section speak in specifics about ciirricuLar 
and course design and instructional techniques. Collectively, they go a 
considerable distance in establishing a useful catalogue of tactics and 
strategies. That so many discipline areas are represented here is an en-- 
couraging demonstration that the catalogue is open to all of us, regard- 
less of the degree to which content dictates technique. More important, 
however, is the way in which each technique is presented. As one, the 
authors think in terms of sy^Jtem. That is to say, not that each is a 
"systems" man or woman necessarily, but that each has thought carefully 
about how content and pedagogy fit together into a coherent ur:it. The 
implication is that the catalogue of techniques is not an automatic do-it- 
yourself kit. It suggests possibilities only. As x^ith a retail catalogue, 
one consciously chooses this or that item because it is an appropriate 
means to a particular predetermined end. The work of selecting appropriate 



instructional techniques is hard. It demands fully as much concentration, 
hard headed analysis and systematic trial and error aj does scholarly 
research. 

In presenting the articles in this section, the ditors deemed it use- 
ful to group them into three sub-sections to highlight different aspects of 
pedagogy. To a certain extent, the groupings are arbitrary. That is, an 
article might reasonably have fit into either of the other two categories. 
The intent was not to set limits on the usefulness of any article but merely 
to suggest possibilities of analysis for the reader* 

The first sub-section contains three pieces. Each focuses on revamping 
curricular design at the introductory levels of instruction; each represents 
a single stage of curricular development and of awareness of the consequent 
implications for pedagogy, especially in what are normally considered "skill** 
courses . 

Professor Bruce Beatie, Chairman of the Department of Modern Languages, 
has written a prosp'^idus on the future of language instruction. He wrestles 
with a hoary monster? having to teach foreign language skills to students 
who are beyond the age when learning another set of linguistic symbols con.es 
naturally. Were he to construct a lingiiistic Utopia, Beatie would have all 
children born to bilingual parents, skilled in both languages by age six, 
and formally trained in second and third languages from kindergarten throi,gh 
cojlege. As a realist, he deals in short-run practicalities. He suggests 
that content be reparceled so that about 20 percent of it be oriented to 
the linguistic place and cultural setting of a language and 80 percent be 
devoted to skill acquisition. As Beatie breaks doim each category into 
specific taxonomies of learning , he demonstrates that curricular revision 
requires systematic reconsideration of teaching techniques. Each part 



of the language curriculum, from the cognitive through the four bviSic per- 
formance skills, requires a cohv<irent instructional design to faci'..ltate 
student learning . 

Professor William Chisholm, . Exiglish , collaborated with the Chairman 
of the Departmn:nt, Louis Milic, in rewriting the fresbnian English curriculum 
at Clevelanvi State, He also has supervised the implementation of t:he pro- 
gram since its inception two years ago. His article constitutes an important 
theoretical defense of the new curriculum., which in many ways constitutes an 
innovation more sweeping even than most "innovative" teachers undertake. 
That is, Chisholm and Milic have worked a revolution in content. They have 
founded their work on two premises about students and their language. On 
the one hand, they argue, students come to this or any university knowing 
"just about all they are ever going to know of the English language." On 
the 1 ther hand, they insist, students^ knowledge about the language is 
abysmally liinited, even perverse in its distortions. On this distinction 
between what students know oif_ and what they know about English, Chisholm 
and Milic define a "strategy for learning". Students, Chisholm writes , 
are "led to make analytical statements about the form of the sentences thc-.y 
speak" and "to examine rationally and critically the opinions they have 
about their language." The achievable goal of this process is that studer.ts 
will develop a means to decide how sentences may be used to achieve claril.y 
and wit. 

To the extent that the revolution in content has already taken place 
the freshman English program is further advanced at Cxt^N^eland State than 
is the introductory foreign-language instruction. In another sense, howe^'^er. 
Professor Beatie has ^one beyond Chisholm and Milic in defining the conse-- 
quences for teaching inherent in curriculum reorganization. Professor Chr.sholm' 
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silence about teaching is l:he subject of a response by Professor Ferris 
Anthony, Education, to Professor Chisholm's paper,* The new English 
curriculum. Professor Anthony admits, successfully answers the questions 
^'what may be taught?'* and "what should be taught?"* But he doubts whether 
it actually defines a strategy for learning from the students' perspective. 
The curriculum, he suggests, does not automatically define what students 
need tc know to master content. Nor does it identify with any precision 
the teaching strategies which lead students to make certifiably rational 
statements, and to examine their opinions, about their language. In short, 
the implications of curricular revision for the. teaching-learning transaction 
are broad. In his paper, at least, Profes.">or Chisholm has not dealt with 
them. 

By way of contrast, the third article in this sub-section, by Professor 
Richard Black of Mathematics, defines an operational model for the conscioas 
union of curricular redesign and instructional technique. Step by step. 
Professor Black plots the evolution of an instructional system from what he 
calls the "one-room school" model which makes little provision for different 
rates and styles of learning to the "educational-park" system which caters 
to all such variations among students. Faced in 1968 with the need to 
structure an introductory course primarily for business administration 
students. Black and his colleagues. Professors Leonard Bruening and Joseph 
Egar, decided that the key to effectiveness in communicating the revised 
content to large numbers of students (many of whom were liberal arts majors) 
was to base instruction on perceived patterns of student learning behaviors. 
The result has been a fascinating interplay between the instructors* connriit- 
menc to content and structure and their nearly complete willingness to 



^Professor Chisholm delivered his paper to an I,T,G. Seminar on Teaching c.t 
Q Cleveland State University in April, 1972. Professor Anthony was a respor.dent 




program* 
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adapt the system to the learning behaviors tbey ob served « The lesson here 
is not that the structure Black, et ad, have built is fit or all courses, 
but rather it is that systematic attention to cne structur^i and results of 
teaching and learning is the essential guide to instructi^~ lal effectiveness 
for more than the few exceptional students in any class • 

Directly following Professor Black's essay is a response to it made 
by Professor Frank Lozier, another of his colleagues in the Math Department*. 
Lozier has taught the same sequence of courses in a more traditional manne?'. 
The questions he raises are important both because they get at real problerts 
and because they serve to remind us that men with markedly different 
methodologies have strikingly similar concerns. 

The next eight articles form a distinct unit in that they contain 
descriptions of specific instructional methods already in the classrooni* 
Together, these articles define a modest central spectrum of identifiably 
effective approaches to teaching. With but one or two exceptions, every 
approach detailed in this chapter would fit somewhere along the spectrum. 

The two lead articles (one by Professor Sam Lane and the other by 
Professor Kenneth Simpson, both of the Psychology Department, and his 
assistant, Mary Ruth Shaw) establish the effective outer points on the 
spectrum of teaching modes. The positions they take are neither extreme 
nor are they polar with respect to one another. Still, each emphasizes a 
different dimension of learning. Professor Lane stresses the cognitive 
domain; he is most comfortable applying aspects of more traditional 
learning theory. Professor Sinpson and !4s. Shaw focus on the affective 
or social domain of learning. They seek to e^qiand the scope of learning 
to include aspects of student's lives typically not regarded as central 
to education* It is not at all uncommon for the proponents of one emphasis 
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to view the proponents of the other in the least favorable !light, even to 
see them as "Prussians'* or ''charlatans" respectively. One cf the more 
interesting lessons of this sub-section is that the cognitive and the affective 
c:?n and ought to be viewed atj complimentary rather than antithetical dimen-- 
sions of learning. 

Professor Lane explores a problem common to every instructor: how is 
it that you get the student, naive and/or unsophisticated in your content 
area, to a level of knowledgeability that you feel comfortable certifying? 
Lane argues, in part, that traditionally oriented teaching does not provide 
a satisfactory and reliable ansx^er. A regimen of aotetaking (on lectures 
and on readings) and bi- or tri-term testing reinforces student tendencies 
to develop information storage and retrieval skills exclusively. In addition 
it does little to motivate consistent intellectual effort and virtually 
ignores one of the essential components of the learning process — immediate, 
feedback about the validity of a student response. Professor Lane argues 
that it is possible to develop a greater battery o? cognitive skills, to 
overcome the motivational "problem" and to operationalizie the feedback 
principle for maximum effect, H?.s "Continuous Feedback Method" relies on a 
basic maxim of learning theory. That is, the effective teacher "shapes" 
learning through forcing the student to make a series of successively 
close approximations to the correct and sophisticated responses the teach(ir 
has defined as course objectives. The demands placed on both student and 
teacher are heavy. The. former must prepare consistently «o that he 
can respond appropriately at any time to the instructor's questions about 
the material under review. The teacher not only must be master of the 
content , he must develop an operable schetp.a of approximations to content 
sophistication against which he can measure any student response to any 
question. There are few te iching skills that demand so active and intelligent 
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an involvement by both student and instructor. But, with learning f; : each 
s^tudent as the objective, is there any more effective approach? Proi essor 
Lane is too modest to make any sweeping generalizations in response o 
that question. He has described a system, at any rate, which sug^;cs^s that 
it would be difficult indeed to find more effective courses ♦ 

Professor Simpson and Ms. Shaw argue that the problem with educ,\'ion 
generally is that, in emphasizing the cognitive exclusively, it prepar^^s 
the student's head for life but not his emotional or social being. In a 
society already advanced in its capacity to alienate its members, this is 
disastrous. \^at they want is to work "personal growth^* courses into the 
curriculum as an integral compo::.3nt of the student's educational experience. 
Let him learn that life is composed at least equally of interactions with 
abstract things (one's task of the moment) and of interactions with other 
beings. Professor Simpson and Ms. Shaw build a systematic rationale for 
this approach based on the course in personal growth the former has designed 
There can bvi no doubt that cognitive as well as experiential learning is as 
essential a goal as experiential learning. Honestly and directly, Profesr,or 
Simpson and his associate face the thorny and fundamental issues of how 
learning in encounter-group courses is to be measured. Indeed, each com- 
ponent of the course, from the statement of instructional objectives to 
evaluate techniques, is meticulously designed and subjected to the controls 
of continuing research input and feedback. Ilore, then, than many inter- 
personal relations courses. Professor Simpson* s retains real and meaningf al 
connections with traditional .academic concerns. 

Professor Howard Oleck describes an instructional method which ha.=; 
strong affinities to that suggested by Professor Lane. The "adversary metho 
an extension of the time-tested preference among law teachers for the casE 
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study, depends upon Tnaximizing student: response rates for its success. 
To learn, students must become actively involved in arranging content. 
Professor Oleck takes special carci to structure assignments so that stu- 
dents learn to search for and deal with the core of the legal problems 
posed. Like learning theorists, he argues that '^effective n^ethod" is a 
necessary ingredient for ef f ec;tive teaching , c . for teachers who thrive 
on classroom dynamics. He asserts that the adversary method is effective, 
if properly designed, and that it can be adopted successfully in other 
disciplines as wide-ranging as history, literature and military science. 
The emphasis, clearly, is cognitive. The method works by fusing the case 
study, independent but structured student examination of issues and role- 
playing recitations into a coherent and monitored whole. 

Closer also to Professor Lane's emphasis than to Professor Simpson's 
is Professor Marina Kurkov's description of the goals of a highly experi- 
mental approach to introductory language training. 

She describes a method which certainly is unusual. It is doubtful 
whether many instructors can think immediately of a use for a technique 
which relies on creating conditions of relaxed awareness. The cynical 
among us might even object that student behavior ±n many classes already 
appears suspiciously consistent with such conditions. Learning does not 
seem enhanced thereby. However, Ms. Kurkov focuses on an important psyche 
logical problem: reducing anxiety and stimulati-ng mental receptivity. Sh 
is appropriately circumspect in spelling cut the theoretical basis for 
"Suggestology" and especially in defining rigorously the conditions under 
which the method is employed. For one thing, it is used for precisely 
defined purposes in a languaf^e tir ills course. It does not supplant other 
essential techniques such as recitaf;Ion. And, thoug'i it may be novel in 
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this country, it has had an extended history of elaboration in Bulgaria. 
The data Ms. Kurkov has culled in support of the superiority of the 
technique over more traditional methods are more encouraging than conclusive, 
but they command our attention. Perhaps the. mcQt relevant point here is 
that Ms. Kurkov does not confuse ends and me.ans. She employs **suggestology** 
because she believes that it is a psychologically valid and effective way 
to accomplish the instructional objective which is cognitive mastery of 
specified content. In this respect, her article is appropriately placed 
near the end of the instructional spectrum taken by Professor Lane. 

Firmly entr (inched on T nne * s side rf the spectrum is Dean Jack Soules. 
Like Lane, Oleck and Kurkov. Soules In concerned with maximizing cognitive 
skill development. \^at distinguishes Dt:an Soules* article is its concen-- 
tration on the practical. Explicitly disavowing any intent to deliver 
''a sermonette on good teaching", he addresses six minor instructional 
problems, the sort which perplex all of us at one timci or another and which, 
taken together, can add up to an immense drag on instruction if left 
unresolved. Soules is a physicist^ so one or two of his suggestions may 
not appear feasible outside the physical or natural sciences. Vet, if we 
•substitute structured assignments for **laboratory experiments", all his 
instructional tactics can be adapted to most courses. In particular, the 
spirit which informs each technique is convertible currency. Soules 
challenges us to develop meaningful course objectives, to relate certifi- 
cation of student performance to those objectives, to provide experiences 
which stimulate skill developn^ent , to involve as many students as actively 
as possible in performance situations even in large classes, and to set 
up meaningful feedback and reward structures. Better yet, he demonstrates 
that each step is possible. 



We move toward the center of our instructional spectrum with the 
next two papers, one by Professor Susan Gorsky and the other by Professor 
Alberta Turner, both of the English Department. Both instructors have 
rethought the traditional pedagogy in terms of enhancing the probability 
that students will be motivated by emphasizing that they have the capa- 
bility of making meaningful, i.nductive statements about content. Far too 
many courses, they imply, are designed with the student consumer as only a 
peripheral consideration. If one adopts a student consumer orientation, 
as Gorsky and Turner do, the emphasis subtly shifts from a concern with 
teacher as authority to a concern with the creation of a learning experience 
which gets students to tap their own creative energies. How many courses 
never get off the ground either because too little attention is paid to 
insuring that students make initial involving and committing responses or, 
worse still, because we fail to recognize that many students believe that 
they cannot contribute anything of value in intellectual matters? 

Professor Gorsky has wrought an intriguing rationale for the inductive 
approach to literary criticism. She has adopted a standard, rigorous 
critical methodology — formalism — to continuing classroom polylogue 
about the contemporary novel. The method is one in which '^passive attention 
(or non-attention)** is replaced by direct involvement by students in their 
own learning experience. \^at Ms. Gorsky does not say is that the class 
or peer group forms an especially stimulating affective environment for the 
intensive, on-the-spot examination of difficult texts. Issues remain. For 
example, was the success of the course a function of its small size? 
Ms. Gorsky does not provide sn answer here but she raises and honestly 
addresses other questions — about coverage of material, about use of 
authorities, about the value of other critical perspective? . The impression 
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overall is that she has designed a model course from which we can learn 

a great deal about the effective marriage of the cognitive ana the affective. 

Professor Turner's approach bases its premise more explicitly than 
Ms. Gorsky's on utilizing affective techniques. She begins by assuming 
that "the ability to write a poem is as universal as the ability to use 
any other form of verbal communication*' and that "it can be taught — in a 
classroom." Her secrets are revealed through three of her by-words — 
"self-teaching", the "inductive" and "affective communication" or the use 
of verbal patterns "to surprise, disturb, and so energize" the writer. 
Writing poetry is an intensely- personal skill. Therefore, Ms. Turner has 
constructed a series of free association exercises — games, if you will 
— which get students to discover the patterning of their inner thoughts. 
Like poets do. And, as a master of poetry and its formal study herself, 
she uses these exercises to illustrate such critical poetic usages as 
concreteness, rhythm, spaci.:.g, non-repetitive repetition, allusion, opposites, 
metaphor and ambiguity. The sources of poetry ar^ emotional. Her course 
accepts this reality and turns it into instructional method. She suggests 
that, on a limited basis, pushing students to respond affectively to formal 
content in other disciplines may earn institutional dividends such as the 
establishment of relevancy, the overcoming of reticence when confronted by 
complex issues* 

The last article in this sub-section is, in one respect, closer to 
the emphasis of Professor Simpson and Ms. Shaw than are any of the others. 
Professor Lance Buhl, History, hao> discarded traditional instructional 
methods in design:Cag irrtrodactory ^'merican History courses. His article 
traces, step by step, the process by whi* i he came to this decision and 
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then, drawing on a. number of instructional traditions, hoy he restructured 
his approach. The probl.em, as he perceived it, was that hib courses 
typically had affected only a i>mall minority of his students. Committed to 
the notion that the classroom formed the chief testing gro-ind for the values 
of public higher education. Buhl sought a method that proirised to etlisure 
active learning by the great majority of students. Abandoned were the 
lecture mode (more central perhaps to history teaching tl jn to any other 
discipline), the notion of teacher as sole authority t enforced student 
passivity and vagueness of goals. In their place. Buhl substituted peer- 
group discussions around specific tasks and case studi<is$ the notion that 
students Were thf: principal purveyors of historical meaning, structured 
and numerous student responses and very explicit behavioral objectives. 
The specific affinity between Buhl's approach and that of Simpson and Shaw 
Is that the former sees in the successful small permanent peer group an 
intellectual home or security blanket within which students 'Tiighv venture 
some educated guesses about the meaning of historical situations At little 
personal risk of seeming "wrong". The more public test of the validity 
of these ideas rf:mains the ability of students to resolve a historical 
problem in a v:ay that is literate, logical and plausible* 

The response of Professor Carl Semmelroth, Psychology, to Buhl's 
paper is a fitting way to close this part of the chapter. Semmelroth 
underscores two fundamental considerations. First, he argues that the 
key to instructional success, (i.e., stimulating student learning) is for 
the instructor, already the master of content, to set up an integrated 
series of "do-able'* tasks. Through such tasks students can attain specified 
levels of content mastery. In this respect, Semmelroth conclud€i.s, Buhl's 
approach apparently has succeeded. Even more important, however, is the 
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milieu in which effective teaching is attempted. Instructors who utilize 
the clear lessons of learning theory must be rewarded. Otherwise, 
Semmelroth suggests, effective instruction is likely to remain a sometime 
thing. 

The last four articles in this chapter outline particular "technologie 
of instructional analysis. Undoubtedly, one or more of the authors would 
deny strenuously that they are not at all concerned with gadgetry or 
machines — that is true. "Technologies" is used here, not to imply 
mechanistics, but only t:o denote that the author (s) of each article has 
examined or presented a technique or procedure for carrying out an 
analytic operation in teaching,. (This is a definition close to one used 
in Webstet*s New World Dictionary.) Each of the articles defines a highly 
informative model for one or another mode of analyzing the instructional 
process . 

Profess >rs Robert McNaughton and Richard McArdle, of Education, for 
example, give practical emphasis to all that we hear these days about 
behavioral objectives. The authors collaborated on developing a Co»;.roe, 
curriculuir and methods, that would meet (a) a number of needs for students 
(b) criticisms by faculty in the University and staff in secondary schools 
and (c) goals defined by the instructors. Their project was ambitious. 
The means they chose met their expectations. 

The specific merit of Profs. MacNaughton ' s and McArdle's article is 
that it demonstrates, through particular example, how a course can be 
systematically constructed from the statement of objectives to the elabor^. 
tion of specific skill tasks for meeting each objective and, then, through 
evaluation of student performance and course components. For those of us 
in Arts and Sciences, it is tempting to dismiss the relevance of the 
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approach adopted by MacNaughton and McArdle. After all, we might argue, 
theirs is a practicum as much as it is a content-oriented course. The 
examples upon which they elaborate, fortunately, are proof of the cognitivti 
rigor they prescribe. The authors have gone far in dismantling myths 
about the supposed resistance of course substance to systematic translation 
as belavioral objectives. The translation does not destroy the int.egrity 
of content. It enhances the effective learning of substance. 

Professor Phillip Emerson, Psychology, follows another instructional 
road, one that is becoming heavily emphasized in contemporary education — 
computer-assisted instruction. But, unlike so many who find the computer 
a useful tool in teaching^ Emerson avoids both massive machines and equally 
massive rhetoric about the wonders of the technology. On the contrary, he 
suggests thnt one can build a very flexible software system, using the 
relatively simple SNOBOL language, for use with smallish computers. With 
great precision, Emerson charts a strategy for ejiploying the system in sucn 
a way that the basic principles of learning theory are carried out for 
each student. He concludes that the system he describes "trades a little 
intuition to gain much freedom for the course author to simulate the real- 
time decision process of a sen:>itive tutor." Those of us draxm to the 
instructional possit ilities of the computer v/ill appreciate the care with 
which Emerson progresses through his system. 

Professor Ray Schultz, Business, starts with the point made in the 
criticism of higher education, that it is a "technologically nonprogressive 
industry". That is, innovaticns, capital accumulation (defined as the 
"congealed labor" of the. professor) and economies of large scale are rare - 
so, there are not significant increases in output per professorial hour 
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of work. This all may sound a bit much to those who feel that teaching 
stands apart fron mean market conditions. Inplicitly, Schultz responds 
that such qualms are born of profound naivete about the mechanisms through 
which higher edr.cation is funded. Any examination of the rules in this 
State amply provide.^ grounds for Schultz' s approach. Explicitly, he works 
to demonstrate that it is possible to mear.ure statistically what is 
effective and productive use of professorial time (or capital) in a course 
he has taught. Not by coincidence, a definition of that also serves as a 
definition of effective instruction, that is, t-iaching which maximizes 
student learning. Instead of describing an instructional system v;hich 
depends on large enrollments and reduced student-* teacher contacts • as 
sceptics of the approach might expect, Schiilts argues that the teacher 
can be used in many more useful ways, one-to-one, even In large courses, 
by abandoning lecture and maximizing use of other instructional tools. 
In short, he demonstrates that the techniques of economic analysis do not: 
rob teaching of its essential human quality. His is a fascinating piece. 

The last article by Professor Ella McKee, Modern Languages, is a 
carefully documented evaluation of courses in Beginning German taught 
through programmed materials. The evaluation is excellent in a number of 
ways. For one thing, it was rigorously constructed so that biases would 
be minimized. For another, it vjas just as rigorously applied. Even 
students who dropped the course were polled. Significantly, Ms. McKee 
assumed that student input was a necessary condition of meaningful evalua- 
tion of Instructional method, in order Co increase the range and number »)f 
data. Perhaps more important^ Ms. McKee was prepared to ask the hard 
questions, to face the least supportive data honestly and to derive from 
the data appropriately circumspect conclusions and recommendations. In 
other words, Ms. McKee has constructed an exemplary model of the way in 
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which the conscientious teacher subjects her work to close, systematic 
scrutiny for improvement. Each class — each student — deserves no less, 
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THE STRUCTU?;^ING OF INTRODUCTORY LANGUAGE PROGRAMS: 
A THEORY AND A PROPOSAL 

Bruce A. Beatie* 

It is an axiomatic assumption of this paper that language* learning at 
the college level is influenced by a set of conditions radical y different 
from those under which most college-level learning and teachir , takes place. 
The theoretical aspect of this paper is an attempt to define s accurately 
as possible the parameters and conditions, under which college -level language 
learning takes place; the proposal is for a structuring of the language- 
learning (and, of course, teaching I) situation which will^ within those 
defined conditions and limitations, lead to the best possible learning at tie 
least possible cost. The proposal attempts to ignore insofar as possible 
both ^'the way things always have been done,'* and the nature of available 
learning materials. These are, in fact, rfilevant parameters as well, but 
they seem to me less inevitable than those described at length below. 

Definition of Pavameters 
The limiting conditions aff<2cting lan.'^uagc learning and language teach.ng 
at the college level seem to fit into five categories: attitudes, curricul^tr 
situation, the phenomenology of language learning, the administrative and 
fiscal structure of the university, and *'goals" (both personal and pedagogi':al 
at 3 variety of levels) • In practice, tiiese categories interact constantly; 
for descriptive purposes, however, it is necessary to isolate and discuss eich 
category in turn* 

Ge neral American Attitudes 
This sub-category is synthesized nost succinctly by Henry Higgins' 
plaint at the beginning of My Fair Lady : "Wliy cau*t the Englijsh teach their 

Q ^Professor of Modern Languages, Tae Clevex.'.nd State University 
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children how to speak?" The English-speaking peoples have traditionally, 
at least since the sixteenth century, paid less attention to language as a 
phenomenon, to their own language, and to other peoples' language than has 
any other linguistic group v^ithin the Western world. Whether this is due 
to geographic insularity, to politico-economic >,dominance , or to some combi- 
nal:ion of reasons is anyone's guess - The fact is nonetheless obvious, and 
the United States has not only inherited, but indeed intensified the "Anglo- 
Saxon attitudes" of the mother country. This linguistic xeiiophobia, 
paralleled in history only by that of the ancient Greeks (whose word "barbai ian" 
means basically "people whose language sounds like a dog's barking — 'bar-bar'"), 
became virtually an American policy of acculturation as part of the "melting; 
pot" concept dominant since the last half of the last century. 

C hanges in American Attitudes 
At this point, in the middle of the twentieth century, it seems as 
if those attitudes are undergoing some fundamental changes. On a national 
level, the changes are doubtless related to the increasing internationality 
of world society, and the increasing international involvement of American 
business; low student air fares to Europe, and the EURAILPASS are carrying 
this change down to the level ox young people. On a local level, the 
ethnic movement and the trend toward small-group identification within a 
pluralistic society. On the individual level, especially among the 
younger people, the change is, associated vith "Consciousness III", with a 
new openness toward polycultural influences; A parallel can be made, and 
should be exploited, between mind-expanding drugs and mind-expanding languages. 
These changes, however, are happening with all the slovmess of all major 
cultural changes, and have not gone far enough at this point to be considered 
a ruling parameter. They are, however, relevant to the question of goals. 
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Specific Student Attitudes 

The attitudes toward foreign languages on the part of the a>^erage 
college student are, of course, a reflection of the general national attitudes, 
but they are affected as well by aspects of curricular structure , and have 
effects in their turn upon the phenomenology of language-learning, 

C urricular Situation 

The fact i :self 'chat extensive introductory language programs exist 
at all at the college level is a function of attitudes, and not of peda- 
gogical realities. In the admittedly ''elitist" American curricular structur<5 
prevalent zn. the nineteenth century (an imitation of European, especially 
German models), most introductory language^ learning took place at the elemen :ary 
and high school levels. At the college level, languages were taught primarily 
as philology, as subject matter rather than performance skills. 

With the populist revolution, however, attitudes begart to affect the 
priorities that determined curricular structure • Language study began to 
be considered a luxury rather than a necessity, and the "buck'* was passed 
from the elementary schools to the high schools, and from there to the colleges 
(college language requirements per se did not begin to be articulated tormal.Ly 
until the late 1920 's) The reductio ad absurdum of this whole historical 
process is the existence of foreign language requirements at the Ph.D level — 
the requirement of what amounts to elementary-level learning at a time when 
the student is ready for, and involved in, advanced specialized study. 

The historical change which began around 1900 seems to be continuing. 
The changes in American attitudes described above may shift its airection, 
or may even reverse it, but we must for the moment live with its consequences. 
Ifliere introductory language-learning should be in the total curriculum is 
a function of the phenomenology of language-learning, and will be discussed 
below • 
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The Phenomenology of LanguagG^-Lnarning 
The principal parameter here is the primacy of the spoken language. 
A child learns his mother tongue inductively, and very rapidly, in a process 
of habi^uatiou not essentially different from all the other habit-patterns 
a child develop'^ in order to '*deal with/' function in, and interact with 
the world around him. Language-learning differs from other forms of habituation- 
learning primarily in the degree of symbf^lit. ' or symbolization involved. 
The written language is essentially a metalanguage, or language-about-language 
imposed on the primary spoken language. It can try to impose logic on the 
spoken language (traditional Latin-based grammars) , or it may try simply to 
describe or represent the spoken language. 

Neither the spoken nor the v/ritten language can be considered primarily 
as a tool (as are the languages of mathematics, professional jargons, or 
computer languages)* Benjamin Lee Whorf goes so far as to suggest that language 
is perhaps the determinant of all thought and perception, and hence prior tc 
thought. Though his extreme view has been criticized, it is by now an accepted 
linguistic axiom that language (and by that I mean '^the mother tongue*^) is 
at least one of the principal determinants of thought-^patterns and modes of 
perception . 

The ease with which a child learns these crucial habit-patterns is one 
of our crucial parameters. There seem to be four basic abilities involved: 
aural orientation, imitative ability, inductive ability (the ability to use 
analogy),, and openness to the new. All of these abilities, for the average 
individual, decrease with age. The decrease is probably not a function of 
aging itself, but of patterning in the learning process; the more an indivi(lual 
perceives order in the phenomenal world, the more his behavior is deccrrained 
by learned patterns rather that by real phenomena. 
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Learnin^ a Second or Foreign Language 
For a pre-school child, the learning of a second language is nearly 
as easy as the learning of his mother tongue, under the right circumstances. 
Research in bilingual families and bilingual cultures shows that the bilinguil 
child begins to speak both languages as soon as does the monolingual child does 
his mother tongue. He is significantly slower than the monolingual child 
in developing reading ability, but then catches up rapidly. By age 6-8, 
the bilingual child is usually as competent in both languages as the mono- 
lingual child is in one> with no apparent loss in other areas of learning. 
Indeed, the bilingual child will tend to learn in later education both faster 
and more easily than the monolingual child . 

The right circumstances, however, are essential. The child must have 
not only bilingual parents, but a bilingual peer-gioap. The latter is the 
more important. If it is lacking, the child may learn passive skills in 
a second language, but will often refuse categorically to learn, or at least 
to practice, the active skills. This is, in a different way, a problem of 
attitudes again. 

The college student, on the other hand, has spent 12 years unlearning 
precisely those abilities which make language-learning easy, and has often 
developed an attitudinal set which may, in some few cases, literally cause 
a so-called "mental block" against the learning of a second language. The 
problem is complicated by the fact that, on the one hand, the four basic 
language-learning abilities are not lost in lock-step (some students, for 
example, may maintain a high degree of aural orientation at the same time 
that they lose imitative ability to an unusual degree); on the other hand, 
the development of other sorts of abilities happens differently for different 
individuals. These facts have two important consequences as far as college- 
Q level language-learning is concerned: (a) The rate of effective language- 
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learning varies so widely from individual to individual that the normal five- 
quarter (or six-quarter J or four-semester) learning senuence is a compromise 
that literally fits almost no student. Some can learn in two or three 
quarters what others may take eight to ten quaiters to learn: (b) Students 
have widely differing learning abilities with respect to the so-called 
"four skills" of reading, listening, writing and speaking • Sonle can learn 
to speak very easily, but have great difficulty learning to write graTnmatical.".y. 
Others can learn to read easily, but may have great difficulty in understanding 
the spoken language. This means that, in addition to the general problems of 
second-language learning, there are specific problems associated with each 
of the four skills. However, since these will have to be mentioned again 
when discussing specific aspects of my proposal, I shall postpone these 
highly specialized parametirs to that point. 

Administrative and Fiscal Structure of the University 
Since these differ from institution to institution, and since many of 
the parameters in this area arouse various sorts of emotional reactions, I 
shall simply list them in outline form: 

1. Organizational parameters- 

(a) Types of classroom space available, 

(b) Other facilities available (language laboratory, etc.), 

(c) Time-structure (block-scheduling system, etc.) , 

(d) Term-structure (quarter system, etc.). 

2. Curricular parameters- ^ 

(a) Prerequisites (in terms both of entrance requirements and of 

course-to-course progression), 

(b) Balance (major requirements, area requirements, desire for 
- - ' electives) , 

(c) Credits (how to balance lab credits against lecture credits, 

performance-skill credits against subject-matter credits). 
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(d) Goals (see below) . 
3. Fiscal parameters- 

(a) Introductory language courses generally have the lowest level 

of support within the budgetary structure, which means that 

(b) Introductory language courses generally must enroll somewhere 

around 30 students in order that the departmental budget may 
break even; but 

(c) Any introductory language class of the usual type (balanced 

four-skills approach) loses about 4% to 5% in effectiveness 
for every enrollee over 20; in other words, a class of 30 
students is about 50% less effective than one with 20 students. 

Whether defined or undefined, explicit or implicit, ''goals" exist 
within the university at a variety of levels, and they often seem, if not 
mutually contradictory, then at least less than coherently interdigitated . 

Goals of Language Teachers 

Our department went through the exercise, nearly a year ago, of attempt- 
ing to reach a consensus as to our own internal pedagogical goals, and the 
results of these deliberations are available in our essay ''On L anguages, 
Language-Learn ing>, and the Language Requirement." Briefly sumi.;arized , they 
are as follows: development of performance skills in a second language to 
the pint where the f orgetting-curve is approximately equal to that obtaining 
in other college-level courses; an integration of skills-learning with 
changes in attitudes, and with knowledge about the phenomenon of language 
itself and the culture carried by the foreign language leained* and in an 
ideal academic universe, this should be fully integrated with other parts of 
the "liberal education" curriculum — this last, however, b<iing a goal which 
we alone can implement, only to a limited degree. 

Goals of Other Disciplines, of the College, and the University 

This is an area within which even angels, :o say nothing of the individual 
faculty member, fear to tread. At Lhe Clevelan/ State University and elsewhere, 
curriculum committees are presently discussing eit?ier this problem itself, or 
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else structural problems which depend implicitly upon goal-definitions. 

It is sad to obsei'/e how frequently structural changes are made, often of a 

radical nature, without prior consideration of the different systems of educational 

goals affected. This might be an area where the methodology of systems 

analysis could be applied with profit. 

Goals of the Individual Student 

At the Cleveland State University, the average student seems to have 
principally use-directed goals. He sees his degree as d ^'union card", and 
his usual question with respect to any piece of the curriculum is: "What 
can I d£ with it?" This view seems often in direct conflict with the tradi- 
tional goals of the "liberal education", at least as I perceive them. 
A Proposal for Restructuring Introductory Language Pro g,' rams 

In attempting to translate the parameters described above into a 
program which is both efficient and effective, I need to restate in somewhat 
more dfjtail the specific goals on an introductory language program. They 
fall into two categories which differ in approach. 

In terms of performance skills , whir.h amounts to perhaps 80% of the 
total time spent in introductory lan^^uage programs: the program should 
develop minimal internalized proficiency in reading, understanding, speaking 
and writing a language beyond the student's mother tongue. (These four as- 
pects, the traditional "four skills", represent a behavioral sub-division. 
A more descriptive categorization might define the performance goals as: 
"minimal internalized command of the phonetics, the graTHTnor, the lexicon, 
compositional skill and conversational skill in the fc reign language." This 
sub-division, however, tends to confuse real performance skills with subject- 
matters and with analytical categories.) 

In terms of subject-matter , the program should develop the student's 
awareness of traditional attitudes, his knowledge of language as a phenomenoa 
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and of the interrelationships of existing languages, and thereby develop an i'l- 
formed self-critical attitude toward his native language. Furthermore, the 
program should impart both knowledge and, where possible, direct experience 
of the culture (literature, customs, history, etc.) carried by the foreign 
language being learned. 

I shall discuss the implementation of these goals first in terms of 
learning mudes, and then in terms of organizational structure. The separation 
is, of course, artificial. 

Learning Modes 

The subject-matter goals can most efficiently, and perhaps even most 
effectively, be implemented through a combination of large lecture and 
small-group discussion. In most current introductory language programs, 
these: goals are met through random, off-hand excurses by instructors. The 
best learning mode would involve four steps: (1) coherent organization of 
the naterial (a syllabus), and (2) extensive readings, underlined by (3) large- 
scale lectures, further reinforced by (4) small-group discussions. The 

\ 

question is where does this material belong within the program? That which 
now comes to the student through random comments can, of course, be pulled 
out of the language-skill sessions and organized into il t^ingle-term courfie. 
Such a course could be placed at the beginning of an introductory language 
program, but may not be fully effective there for two reasons: the general 
linguistic material needs concrete examples from more than one language in 
order to be internalized, while the target-language material cannot be taught 
effectively until students hava some basic knowledge of the target language 
itself. It could be placed at the end of an introductory language sequence, 
but one loses thereby the crucial perspective on the whole skills-learning 
process which this subject-natter provides. The best mode is, therefore, 
probably to present the subject-matter throughout the skill-learning sequenr.e, 
on the basis of weekly or bi-weekly lectures. The general linguistic mater ,al 
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should be presented roughly in parallel to the first three quarters (first year) 
of the skills-sequence, and the target-language material parallel to the last 
two quarters. 

This learning mode has several advantages over what happens currently ir 
introductory language classes: (1) Thr ^e is a core of systematically- presented 
subject-matter running throughout the perf ormance-skill-learning sequence, 
making possible (2) a basic syllabus for all fir^^t-year language courses, ard 
separate target-language syllabi for all sections of a single second-year 
language; (3) performance-skill clas.^>:;S can both use constantly the knowledge 
and insights derived from concurrent lectures,^ and can serve as the small- 
group discussion section for the lecture materials; (4) the best possible use 
is made of those faculty members who are charismatic lecturers; (5) the 
approach is adaptable to possible videotaping; and (6) it is highly efficient 
both in use of faculty and in scheduling, since the general linguistic lectures 
can be offered at one time to all first-year students, irrespective of language, 
and the target-culture lectures at one time to students in all sections of a 
given language. 

The performance skills cannot properly be isolated from one another. 
Not only are they mutually interactive in practice, but our surveys of student 
interest in various aspects of language-learning suggests that most students 
wish to learn all four skills simultaneously. However, not only do the four 
skills differ in tennii of effectiv^e learning modes, but also, and very widely, 
in terms of rates of learning. An effective program, therefore, must attempt: 
a partial isolation. 
Reading Skills 

These skills are the easiest to learn, and for most students can be 
learned rapidl}'. If texts are carefully graded, and are associated with much 
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visual material, reading can be be^un with a minimal grasp of grammar. 
A totally programmed reading course is not only feasible, but already exists 
for several languages. Especially at the beginning levels, development 
of reading skill scarcely requires contact with at? instructor. It does 
require, however, a reasonable high degree of self-discipline and motivation 
on the student's part. As skill develops, interest in ^^iscussion of the 
readings develops, and that requires an instructor. Discussion itself, 
however, is not directly related to development of reading skill. 

We should, therefore, set up for each language a pro.^tom of reading- 
skili goals outside of any classroom situation. A given level of proficiency 
can be defined, for example, as — pages of a given level of difficulty, 
read within — minutes and with demonstrated comprehension.'* Ic should be 
remembered that reading is a skill which can be tested ob;' ectivcily , using 
machine-gradable tests „ 

The advantages of this mode are that: (1) it makes maximum use of the 
self-testing potential, and (2) offers the student virtually unlimited 
self-pacing, as well as, at somewhat more advanced levels, (3) considerable 
individualization in terms of materials read; (4) it makes little use 
of expensive faculty time. Its principal problem is that relatively few 
appropriate learning materials, especially for the beginning levels, are 
available. 
Listening Skills 

Understanding the. spoken language is, like reading, a set of passive 
skills, and hence is also adaptable to a programmed approach; the effective- 
ness of a programmed approach to listening skills, however, drops off much 
sooner thai: that of one for reading. Nonetheless, a listening program can 
be developed, parallel' to that for reading, where a given level of proficient 
can be defined as "havii>g listened to — hours of material of a given level 



of difficulty, with demonstrated comprehension.'' Listening skill, too, can 
be c ted objectively, using machine-gradable tests. 

The advantages and problems are the same as those defined for the 
reading skills. Here we encounter, however, the additional problem that 
there is a radical difference between the experience of foreign-language 
spoken materials in a listening-booth through earphones, and the live ex- 
perience of either simply listening to a person speak (lecture) , or listen- 
ing to a conversation. In the live situation, body language, gesture, ex- 
pression, dialect, intonation, ellipsis, broken sentences, simultaneously 
increase and decrease the problems of understanding the spoken language. 

This transference problem, however, ir- in a sense automatically taken 
care of by the fact that, while listening can be learned on a self-study 
basis without really learning another skill (as can reading) , the speaking 
skills cannot be learned without simultaneous development of listening sk-lls. 
Hence the approaches described belov; (under **Speaking Skills**) provide to 
some extend the "living-experience^' component of the listening skills. 
Writing Skills 

Writing, in contrast to residing and listening, involves a set of active 
skills, and has two basic prerequisites: a minimal grasp of grammatical 
structures, and command of a minimal lexicon. Development of writing 
skills requires extensive writing practice, v/ith constant corrective feed- 
back. It is therefore much more difficult to develop a self-paced prvOgrammed 
approach to writing. Bcr.h grammar itself (as a body of knowledge, not as 
a generative skill) and a lexicon can be learned through programmed materials 
both can also be learned inductively through development of reading and 
listening skills. But since writing is a generative skill, generating not 
only an infinity of possible sentences, but a mega^inf inity of possible paragraphs 
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and longer communications, there is no way of setting up a self-t-i^sting proc(»dure 
^ much beyond the beginning level, (Not even direct translation against given 

models works here, for obvious reasons — and the act of translation is in any 
cast a violation of some basic principles of language learning.) 

Hence an instructor is a necessity within a writing program^ mainly 
functioning as corrector and guide in writing practice. The level of pro- 
ficiency which such an instructor must possess, however, is much lower than 
that necessary, for example, to teach speaking skills • The writing done by 
students at the first- or second-quarter levels, for example, can easily be 
corrected by student.^ (good students, at least) who are on the fourth- or 
fifth-quarter levels (for whom it amounts to useful reading practice; the 
writing done toward the end of the introductory language sequence can ea-ily 
be corrected by upper-level language majors (for whom it's not only reading 
practice, but an introduction to language pedagogy as veil). The most effective 
mode of learning writing skills is therefore a tutorial situation, supple'ner ted 
by constant correction of writitig practice (for which student-corrector 
contact is not necessary) . 
Speaking Skills 

These are the slowest of skills to develop, because they are active, 
generative performance skills bound by time . Response must be made instant!.y. 
There is not time for reflection and consideration that is available in wri':ing5 
the other active set of skills. Furthe^. .T?ore , modes of analytical-deductive 
learning are almost totally irrelevant here. Like the writing skills, spea!cing 
can be developed only through practice, but here the practice is much more 
clearly a process of habituation, the development of stimulus-response hab:^ : 
patterns that can function without conscious reflection. 

Furthermore, while the listening skills, as wa? mentioned before, can 
^ be developed in relative isolation from the other s^kills , the speaking skills 
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c annot be developed without simultaneous development at least of the listening 
ski''. Is. Speaking proficiency is doubtless helped by increasing proficiency .n 
reading and writing, but these skills are not absolutely necessary to speaki:ig, 
as the Berlitz method shows. Laboratory practice tapes are helpful, especially 
in developing listening skills, and can give essential practice in generating 
isolated sentences as well as very limited practice in stimulus-response pat::erns. 

However, n_o practice in frae speaking is possible without the conversational 
classroom situation. Hence this is the only one of the four skills where thn 
classroom teacher in the accepted sense is truly essential. The term "classroom 
situation" includes, in this context, t"^70 different modes: (a) tutorial : 
conversational practice carried on in a completely free person-to-person 
way, without any obvious structuring (though, of course, some structuring is 
implicit in the study materials, and the tutor must mentally pre-structure 
what he wishes to accomplish in a given session) . The upper limit of group 
size in this mode is 4-6 students. (b) class : once a group goes beyond 4-6 
students, real "free" conversation becomes impossible, and a much more 
overtly-structured learning situation is essential. Choral repetition and 
pattern practice supplement here a limited amount of free conversational 
practice. In the "class" situation, group dynamics suggest a lower limit ol 
effectiveness may be around 10 students; the upper limit is clearly 18-20 
students. (It should be remembered, as noted earlier that ^-^ :-,aing effectiv e- 
ness in a conversationally-oriented foreign language? class drops about 5% 
for each student enrolled above the limit of 20.) 

Class practice in developing speaking skills can be handled effectivel;' 
only by a trained teacher with a high degree of fluency. Tutorial groups can 
probably be handled by good language students T/hose level of proficiency is 
about three to five quarters ahead of the staidents they are tutoring. That 
O is, fourth-quarter students can probably tutor first-quarter students, 
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advanced majors can tutor fourth- or fifth-quarter students, and so on. 

It should be remembered cnat, thus for, no objective methods of testing 
conversational skills have been developed. 

Organizational S^ructur r^ 

The principal problems in this area are: s^ ^^-^duling , progression, and 
evaluation (all of which can be loosely classified as "sequencing" problems) > 
and "completion" (definition of the stage or level a' which internalization 
of the foreign language has reached the point where the forgetting curve will 
be roughly equivalent to that of other coIIege-Ievel courses- The only area 
of the four skills where sequence is essential is in developing speaking 
skills: beginning students cannot function conversationally in classes or 
tutorial groups witl. students whose proficiency is substantially higher. I i 
any conversationally-oriented group or class, relative homogeneity is essen:ial 
Nearly the same thing is true of listening skills, insofar as the classroom 
situation is concerned. 

Conversation-oriepced sequences must therefore be tied to achieved 
proficiency, not to attendance; in them, letter-grading is inappropriate 
for a variety of reasons, and Pass/Fail a viable alternative. 

Out-of-class reading, listening and writing programs can be internally 
sequenced, with the syllabus-determined sequence of self-study materials 
and the progressive tests determining the progres.sion. 

Subject-matter learning is sequenced not by developing proficiency, btt 
by the inherent logic of the body of knowledge to be learned. This area is 
as adaptable to ordinary testing methods (including objective, machine- 
gradable tests) and the letter-grading system a? i.; any body of subject- 
matter taught at the university. 

"Completion" means, as noted, achieying a level of performance-skill 
proficiency that has been internalized to the point where the forgetting- 
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curve approximates that of other college-level courses. It also implies 
completion of the subject-matter sequence. Subject-matter completion is 
easy to document, but for the performance-skills it is, necessary to set 
up a complex set of interrelated tests and evaluations , so that , for example 
someone who develops a very high level of reading skill may use that to 
balance a low level of speaking ability. 

I propose therefore that an arbitrary ten levels of proficiency in each 
of the four perf crmance-skill areas, such that the tenth level in each 
Co '.e means full ability to handle that skill in a course on any subject-matt 
taught in the language being learned. Tenth-level proficiency in all four 
skill-ar<^as would assure the ability to attend a university in the country 
of the target language. This means that level ten is substantially higher 
in each separate skill-area than the performance achieved by most students 
at the end of the usual introductory language sequence. 

The student would then earn one point (one credit) for each level of 
skill achieved in each skill-area. "Completion" would mean accumulation of 
20 points in any combination of skills: for example, tenth-level skill 
in both reading and listening, or fifth-level skill in all four skills, or 
any combination that adds up to 20. 

On the basis of the assumptions stated above, I propose that the intro- 
ductory language prograr^t be organized as follows. Each heading represents 
one or more listings in the college catalog and schedule of courses . 

(.1) General Linguistics . For beginning students and others interested 
2 credits; no prerequisites. 20 class-sessions of lectures, plus readings 
and tests. Lectures biweekly, except for the first week of the quarter; 
the sessions scheduled over three quarters, beginning a new sequence each 
Fall and Winter quarter. Same lectures for students in all languages. 
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Maxiraum lecture-section size: 150-200. The subject-matter should be inter- 
digitated as far as possible with that of the basic English composition 
course, and should refer ahead to other Linguistics courses offered at the 
university, 

(2) Target L anguage a nd its Culture . For siii-lcnts with some ex- 
perience in the target language. 3 credits; prerer^ ite is a comb i-nec 
proficiency-level score of about 10. 25 class-.st • of lec*:ures, with 
readings and tests. Lectures weekly except for tlic first week of the quarte:*; 
the sessions scheduled over two quarters, beginning a new sequence each Fall 
and Winter quarter. Separate sections for students in each target language. 
Maximum lecture-section size; 100. 

(3) Reading Clinic . Discussion and problem-solving sessions scheduled 
weekly, available to students on an open basis some 24 hours each week; a 
faculty member responsible for supervision and some 12 hours of attendance, 
the remainder to be handled by advanced majors and graduate students. 
Student register for 1 credit each quarter that they w:'.sh to use the ser'/ice; 
of the clinic. Additional credit will be granted in a given quarter if the 
student advances more than a single prof iciency-^level in reading. Registration 
allows the student to take tests and have them corrected and scored, as well 

as to take advantage of discussion-sessions and tutorial help. 

(4) Writing Clinic . Its structure is identical to that of the 
Reading Clinic. 

(5) Listening and Oral Practice Program . Sequences of listening and 
pattern-practice materials to be available in the Language Laboratory, open 
some 55 hours weekly; lab attendants will whenever possible be language majors 
who can assist students working in the lab. Students register for one credit 
each quarter that they need to use the Laboratory; registration entitles 

thein also to take listening-proficiency tests, have them corrected and scored. 

ERIC 
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Credit will be granted on the same basis as in the Reading and Writing Clinics, 
(6) Conversation Classes . These will be graded classes roughly parallel 
to those in the usual introductory language sequence. These conversational 
classes will use a standard introductory text, but no vrriting or reading 
practice will take class time; students needing work in these areas will be 
directed to the appropriate clinic. Students will register for 2 credits at 
each class-level. They may be granted anywhere from 1-4 credits depending upon 
their advance in proficiency. There vjill be three to five contact hours 
weekly: three sessions in classes taught by regular faculty members, with an 
upper limit of 20 students. One or two additional sessions will be in 
tutorial groups with no more than five students, taught by advanced under- 
graduates or graduate students. Progression from class to class in the sequence 
will be determined by the combined prof iciency^ level score a student has 
achieved by the end of a quarter. 
For example: 

Spanish I. No prerequisites. A student will normally achieve speaking - 

proficiency levels 1, 2, or 3. 
Spanish II. Prerequisite: a combined level-score of 6 (for example, 

2 from Spanish I, 2 from the Listening Program, and 1 each from 

the Reading and Writing Clinics). A student will normally achievtt 

s^Caking-prof iciency levels 3, 4. or 5 ; his total proficiency- 
^^^^^^^^^score at the end should approach 10. 

Spanish III. Prerequisite: a combined level-score of 12. Achievemen:: : 

speaking-proficiency levels 5, 6, or 7; his total should approach 
^ 18. (In other words, at this point a student should be near 

^'completion" as defined above.) 
Spanish IV. Prerequisite: a combined level-score of 18. Achievement: 

speaking-proficiency levels 7 ^ 8, or 9; total should approach 26. 
Spanish V. Prerequisite: combined level-score of 24. Achievement: 
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speaking proficiency levels 9 or 10; total should approach 3A. 
It should be remembered that the crucial element in the organizational 
structure proposed here is the isolation of subject-matters and the various 
skills and the development of learning modes separately appropriate to 
each which aim at maximizing both learning and efficiency. I hold no brief 
for details of the structure proposed; many variations upon the basic 
pattern are possible, and I am sure that some possible variations. would 
be an improvement over the ones suggested here. 

Conclusions ' 
The introductory language program which I have proposed offers a 
number of concrete advantages over the programs usually offered at the college 
level. From the student ' s point of view, it means that the behavioral 
objectives of the various aspects of the language program are clearly dis- 
tinguished from one another, so that the student may choose to emphasize 
those objectives which interest him. The relative isolation of skills 
also makes it easier to identify a student's special problems, so that, 
if he is getting into difficulty, feedback will come before the problem 
becomes dangerous. Both the high degree of individualization and. "the 
relative lack of grade-pressure in the performance-skill programs will 
eliminate many of the psychological hindrances to language learning which 
are apparent in many current introductory language programs; and finally, 
because of its clear articulation of the subject-matter component in rela- 
tion to performance skills, it should lead to a significant change of 
attitude toward languages and language learning. From the department 's 
point of view, it assures that our goals will be met; especially important, 
it assures that whatever proficiency in language skills is achieved will be 
real , internalized proficiency; and it allows much more freedom and 
flexibility to the individual faculty member. From the university ' s 
point of view, the proposed program is much less expensive than the 
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usual introductory language program, because it makes most effective use and, 
efficient use of both human and technical resources available. 

The proposal doubtless conceals many problems, some of which I am 
aware of. For example, the transition from a standard progran\ to one such 
as is proposed here will surely be an administrative nightmarfa; I am convinc 
however, that the operation of such a program v^ill be no more, difficult 
than that of a more usual sort of program. Secondly, the proposed program 
is designed with heavily-enrolled languages in mind; it may be difficult or 
even impossible to implement for languages where, for example^ initial 
enrollment in a learning-sequence is 30 or less. Finally, there iriay well 
be special needs arising for special courses (for instance, an intensive 

reading course may be necessary as a supplenent to the Reading, Clinic) . The. 

\ 

flexibility and economy inherent in the program, however, shoul^d make it 

\ 
\ 

easier to meet such special needs x\7hen they arise. 



LANCtUAGE in the mind: 
A STRATEGY FOR LEARNING 

William Chisholm* 

I would like f.o begin at the beginning, with philosophy, the foremost of 
man's delights, (So far as I can see, the only thing the fellow who designed 
the Tower did right x-jas to put the philosophers on the top floor,) Philosophers 
typicallv ask these two questions no matter how they formulate them: What do{:S 
a man kno\7? How does he know it? Teachers may well ask these same questions, 
and then set aboui: to follow th»^m logically to a set of consequent questions: 
!• What may be taught? 2. l"Jliy should it be taught? 3, How may it be taught ? 
It is with these three questions and the answers that they have provoked that th 
freshman English program at CSU has evolved. The answer to "What does a man 
know of his language?" will take up half of this discussion. Answers to the 
subsequent questions "I\Jhat may be taught. Why and How?" will form the second 
half, A teacher must a^k himself what his students know. Without asking 
this que£ition and getting somei kind of answer, what can the basis of any 
instruction be? Some parts of the answers suggest, I believe, that our program 
of instruction in freshman English is innovative in petty ways. We might say 
"My students know x. At the end of my instruction they will know x + y. 
Since there is only x, y, z (z being open-ended), I can confidently leave "z" 
to the next fellow," This formulation is silly in many ways. Nevertheless, 
there is something to be learned from iL, As far as the English program is 
concerned, the situation is this: First, the question: IVhat do our students 
know? Answer: Just about all they are ever going to know of the English 
language. They have been in this condition for more than one-half of their 
lives. They each have acquired in their heads what many have called "a 
linguistic device". This explanatory device is such that the rules of Englisl. 

* Professor of English, The Cleveland State University 
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structure are used to solve any and all linguistic problems; that is, the 
students are fully capable of speaking well-formed English sentences. In 
order to do this, they must be in possession of an adequate grammar (= explana- 
tory device) of English. Obviously, this grammar of English is not a faper-- 
back that they carry in their tote bags or hip pockets. It is knowledge. '.t 
is a competence (in the neutral, philosophical sense of the term) that I ha^'e 
named a device. It is as if there were a magic box embedded in the brrin. 
The input to the box from birth is impression, cognition, thought, and especially 
vocal, social data. The output is utterance and understanding. Linguistic com- 
petence is a device, then, in the sense that, we use it to generate sentence;.. 

By definition no one knows what goes on in black boxes, but some thingj; are 
known about what the grairanars in our brains are like. On the basis of a rar dom 
and degenerate linguistic experience, every human being proposes, rejects, 
proposes again, and modifies explanations of the native language. The brain 
constructs a theory that adequately explains what sentences are and what the; 
rules are for matching streams of vocal sounds with meanings. Innately 
endowed to do this work, all humans succeed in becoming the foremost grammarians 
in the world. 

It will be of some help to consider more specifically what I have been 
describing generally and theoretically. Consider this sentence: "Sundance 
rests on his haunches, staring back down the way they've come," That's- 
a perfectly ordinary sentence. It had no existence before the moment that 
the scenarist of the popular movie "thought it up" as he tried to describe some- 
thing he wanted in his movie for himself, his director, and his actors. It had 
no existence except as a potential enumeration of the black box. Here are some 
facts about the sentence: (1) There are exactly two ways that the 12 words of the 
sentence may be arranged from a possible number of arrangements of over 200 million. 
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(2) TheiTe is exactly one circumstance out of an infinite number of circum- 
stances that could provoke the sentence. (3) The sentence carries a comple::ity 
of meaning that is not difficult in any way for a speaker of English to unde 
stand, (4) The sentence is technically unambiguous* (5) It follows the 
rules of English grammar to the hilt. (6) The sentence (if spoken) consist; 
of 50 human spe^ech sounds, none of which has ever happened before. (7) The 
slightest mistake in speaking the sentence would be noticed by any of us; 
"Sundance rests on his haunches staring back dowp. the way they've gum." 
The 48th variable does not belong in the set. If the mistake is a special one 
of this sort: "Sundance bests on his raunches staring back doxm the way 
they've come." then, despite the fact that neither "to best" nor '*'a raunch*' 
exists in English, the noise in the channel may be successfully translated. 
That stream of noise would have ccmmunicated something it didn't say. (Con-- 
sidering the amount of noise in the typical channel that our students usually 
find themselves in, it's a x^7onder that the race has not retreated to non- 
verbal communication) . 

These facts are remarkable. The speaker of the sentence located one of 
two ways that his words could be arranged. He had over 200 million choices. 
He found a stream of vocal sounds that carried a meaning for which there could 
be only one occasion. He communicated a meaning, really meanings , that 
neither he nor his listeners hrid the slightest trouble contemplating. Most 
importantly, he expressed his meanings by consulting wholly abstract linguistic 
rules and unerringly following them. I leave to you to consider the implications 
of the remaining mind-boggier — that the actual sounds he chose (50 of then) 
(I'm thinking, of course, of his saying this sentence not of his writing it 
down) happened for the first and last* time when he spoke. 

If you and I did not have language in our heads and yet we could still 
somehow communicate with one another, and if one of us proposed to the others 
that we set about to invent a human language, the rest of us would have no v^ay 
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even to begin to think about what the nature of the proposal was, let along co 
anything about inventing a natural language. Comparing the complexity of the; 
problem of lobbing a package to Jupiter with the complexity of any human 
language is like comparing a photon with the universe. The '^Sundance** sentence, 
then, _is a small miracle. But there is nothing more commonplace than a sentence. 
Thinking merely of the observations I made about it, from among very many 
observations that may be made, equally intriguing, there can be no denying 
its complexity. More pertinently there can be no denying the miraculous 
complexity of any sentence any of our students write. Here's one: 
*'A mother telling her three-year-old son not to go outside the yard will not 
use the same tone or words that she would use if it were her husband she 
spoke to.'* Here^s another: "Mono-syllable (sic) words and short sentences 
are easy for children to understand/' (There are rough edges on both of these 
sentences but we needn^t be distracted by them). With these as with all 
sentences, it is more than a jiggling of a verbal kaleidoscope that we encouiter. 
Nor are sentences formed by shaking words out of a hopper. Think of it this 
way: Suppose that that second student sentence had been: *'It is easy for 
children to understand short sentences," instead of "Short sentences are 
easy for children to understand'-^", or suppose it had been "For children to under- 
stand short sentences Is easy", or "Children understand short sentences 
easily." Would the same meaning have happened four times, or would four 
different meanings have happened. The answer, of course, is that the different 
sentences would have carried the ^same meaning. We know this to be true, and 
so do our students. The only satisfactory way to explain how it is that our 
students know this is to say that they know English grammar. 

It is not possible to give a very satisfactory description of a competence 
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like this because there is no time. We need eleven weekc; to begin to do it with 
the freshmen. But let me try in a minute or two to sketch the principles. Inci- 
dentally, the kind of grammatical exercise I am about to ^lead you through is a 
good example of the kind that our students facf^_. 

If we start with a meaning like that which is expressed in A: "Children 
are easy understand,*" we can notice that that meaning is captvired again 
in an entirely different grammatical structure, B: "It is easy to understand 
children." If we now take C: "Children are eager to understand," and try to 
express that meaning again in the structure using "it", we get D: It is eager 
to understand children." Something has gone wrong somewhere. Although the 
grammatical rel.itionfihip between A and B appears to be precisely the same as 
that between C and D, those grammatical relationships can NOT be the same. And 
we know they are not. If they were, then the A is to B^ as iC is to would work 
out. The grammatical structure of the first Sfintence in each paired set: 

Children are easy to understar". 
Chiltlren are eager to unders' id. 

merely appears to be the same. But the fact is, in grammatical terms, that the 

subject of "to understand" in ^'Children are easy to understand" does not even 

occur in the sentence. The person or persons who jdo the understanding are not 

mentioned . 

In the other sentencej "Children are eager to understand", the subject of 
"to understand" is "the children". Children are eager to understand. 

This partial grammatical analysis merely explains what a small fraction 
of our grammatical knowledge actually is. In this case, as in many others, a 
knowledge of English grammar is such that it provides understandings of sentences 
partly on the basis of what is not in them. 
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expressed in the previous 3 sentences. 



98 



(The first week of October, the first week of January, and the th,v.:d weak 
of March have provided our students with a shock from which we hope they wiiil 
never recover. \^en you confront a student with his mind, you melt his brc.ins.) 
I hope the point of this is clear. We had two sentences with exactly the same 
structure, yet we understood them in entirely different ways. As many of you 
may know, this fact more than any other has been responsible for the revolution 
in grammatical studies in the past generation. This revolution has spilled over 
into our classrooms* Not the noise and confusion of it, but the Callenges and 
the insights of it. 

So we are near an answer to the imperative question: Name sCin?;thing 
students know? Answer: Students — all of them — know as much jf English as 
anyone. They know axactly how to form the sentences that they wish tc speak 
and to decode sentences that others wish them to hear. That is the answer to 
the question: "What do cur students know of the English language?" 

We ask these two questions next: '*VJhat can we teach them?" "How can we 
make use of what 'chey already know?" 

The answer to the first question is: "Precious little" — not because there 
are not vital things to teach, but because we feel it is more important for them 
to learn than to be taught. (It is here that we make use of what they already 
know*) We get students to induce knowledge about English from their knowledge 
of it. What I mean in familiar terms, is that our technique is inductive. It 
is inductive because there is^ a necessary answer to that second question about 
what use we can make of their present knowledge. The students are led to make 
analytical statements about the form of the sentences that they speak. Tlie 
question, "What can we induce our students to know?" is more apt, then, than, 
"What can we teach them?" They learn to "do" grammar. In this way, they add 
y to X — knowledge about language to knowledge of^ language. This is extremely 



important. There are two kinds of linguistic knowledge: knowledge of language, 
and knowledge about language. Nothing whatever is learned when one learns to 
say that interrogative sentences ask questions or that verbs express action. 
But something of consequence is learned when an explanatory analysis of questions 
or verbs is undertaken. Dy means of such an analysis, i-ne explains something 
about the structure of the language. And it is this that we are after: an ex- 
planation of the structure and the form of the native language. 

Our students' knowledg-^. of_ English is immense, as I hope I have made clear; 
their knowledge about English is pitifully small. Fxankly, it is non-existent. 
If it were merely that their ignorance was profound, it would not be so bad. 
But the situation is much worse. They know thousands of r,hings about the English 
language and almost everything they know is wrong. They believe that siting 
has something to do with language, that Chaucer wrote in Old English and so did 
S.T. Coleridge. (I have been afraid to ask about T.S. Eliot), They think that 
there are five vowels in English (and sometimes "y")« They believe that they do 
not speak a dialect. They derive English from Latin. Tliey think four-letter 
words are slang. They not only believe that "interrogative sentences are sentence 
that ask questions" they believe it is virtuous to know such nonsense. They 
will willingly swear that ver-bs express action, even the verb "to die". (Well, 
I said they know thousands of untruths about English. I will not list them alll) 

The point is this. The part of their brains tV.at does not contain the know- 
ledge of English that I described a few moments ago is jammed with ignorance 
and misinformation about the language. 

Under such circumstances as these, we would be criminally negligent if v:e 
did not encourage our students to examine rationally and critically the opinic.:s 
they have about their language. More importantly, since the English language 
Is our subject, and since, happily, there exists an authentic body of knowledge 
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about it, what could our reasons possibly be for not passing on this knowledge? 

The reasons for teaching it are richer than this, however. Our students 
learn a good deal in our program about the linguistic knov;] edge that their 
minds possess. The consequence of this is that they learn a good deal about 
their minds. There can be no greater education than that (and so I slip back 
into philosophy) . 

So, we teach the raw knowledge by getting students to induce the same 
insights that modern grammatical studies provide about English structure. Wo 
do not teach linguistics. We d£ teach the main facts about the history of 
English structure, and also the social and regional dialects. We consider these 
two topics to be of considerable importance. One of the astounding facts about 
PhDs in English is that many of them have never studied systematically either 
of these topics. So, x^e are plugging a gap but it is not for this reason that 
we do so. We teach such material because any education in language is un- 
thinkable that skips fundamantals like these and not because many PhDs are 
ignorant of some crucial facts about English. Historians do not teach American 
History because it is their specialty. They teach it because a man who does 
not possess it is ignorant — so it is with us. But it is no easy matter to 
teach linguistic history or dialects. 

Part of the difficulty is that our students come equipped with bins full 
of ignorance and misinformation. Most of them who have thought about the 
matter at all, have decided that Old English is an "uk-uk^' language roughly 
comparable in degree of complexity to any American Indian language. After all, 
with only a hundred or so words in the vocabulary pool, and nothing much to 
talk about, v/hat do you expect? Some of our students get away from us still 
believing that the highly synthetic nature of OE structure is somehow inherently 
inferior to the analytical systeb of Modern English. Worse, many think that 
valid 'viewG on this subject are worthless. Such views have nothing to do with 
^rhat they call education. They want something that they vaguely describe as 
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the aecGSsary tools and skills to get a job, even education majors dol Little 
do they know that when they get their first jobs at East Tech or JFK or Parma 
High the students there, and their parents, will demand the same "skills." 
Then, they will wonder what these skills really are and why everyone is so 
agitated about them. 

They will learn that all those hours, weeks, months, and years spent 
driving those so-called "skills" into their students' heads are wasted. No one 
has ever demonstrated the slightest hint of a positive correlation between such 
instruction and the acquisition of writing or reading skills. Until such ti..:e 
as someone notices that you can not learn to run before you learn to walk — 
and we believe that we have correctly noticed this — that you can not have 
knox,7ledge of writing before you have knowledge about language, we will do 
nothing but waste money and time. Trying to get one without the other is like 
trying to build the University Tower without tooi'r:. 

Having acquired knowledge about the form, history and dialects of English 
and having learned something of what their minds are like, the freshiiian English 
students in the second quarter of our program of studies take up the matter of 
English use. Although there is no sure relationship of effect between the 
learning that goes on in the first quarter and that of the second, it is on the 
basis of an understanding of form that the topic of language use is studied. 
This is one cf the suppositions at the heart cf our pedagogy. VJe are con- 
fident that knov/ledge about the English language precedes informed use. 

It may truly be observed that tlie adult population in our society is the 
ready victim of sloganeers and propagandists. In simple language, vje vote for 
^iars and we buy objects for which only advertising has provided a need. In the 
Fall of 1970, Bella Abzug announced that "A Woman *s Place is in the House" 
(capital H) . I would hate to think that Lno lady got elected because she knew 
more about how to use th^ language than her constituents. But I know betth^r. 
That is_ how she got elected. 
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Although thG English Departmert does not see its role as protector of the 
innocent, we do feel that the rhetorical and compositional facts of English 
use arp to be taught* Otherwise, ve risk sending our students out into a cruel 
world wliere people on Pensylvania or Madison avenues know more about how to 
use the English language than they do. 

Let me say it straight out. X^Je rnow how to teach writing and reading 
skills - true skills- Half of the job gets done in the first term. The 
other half begins this way: with a decent rer^pect for English words, more 
specifically, with instruction on how to open a dictionary. The well-made 
dictionary is the repository of essential facts about English words. A person 
cannot crack the code of a dictionary without special training. This 
instruction we provide. If we did not, our students would continue to think 
of it as a spelling book. The difference between "The hydrogen dioxide 
inundated the subterranean chamber" and "The water flooded the basement^' is 
the difference between the hardware and. the software of the English wordstock. 
All matters of diction and tone are describable in quite simple terms based on 
the gross distinctions exhibited by these two sentences. In the first term, 
students learn to handle a generally abstract explanation of the phonological, 
the morphological, the syntactic, and the semantic forms of English sentences. 
In the second, thoy begin by learning how to study and use Vi7ords. Then, en 
route to the hard-won satisfaction of successful composition, they study the 
broad principles of rhetoric , including the effects that certain orderings of 
sentence elements can have; the usefulness of paraphrase, the povjer of syntactic 
substitution, the utility of expansion and modification, the structure of 
metaphor, and so on. They study the dozen or so rhetorical devices that manifest 
themselves (one or the other) in every paragraph or stanza of consequence that 
has ever been written. 

But we do not fool ourselves. None of rhis necessarily leads to the 
writing of plain English. The; trouble is that good writing is not so much a 
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skill as it is an art. In fact, it is not really Xvnriting skills that we trv 
to develop. It is that which precede s v;riting skills, the principles of 
language use. 

Each of us faces a cataract of linguistic events in our daily lives, 
friends commune with us or communicate with us; our enemies howl at us; 
newspapers and magazines seize our eyes; signs blink at us; TV images massage 
us; even our minds rattle away. In such a circumstance, the well-equipped 
college student is the one who has some clear understondi ng of the form and 
the utility of linguistic material. Knowledge of the form that the principal 
linguistic objects in the world have (sentences), and possession of a means 
to decide how these objects may be used to achieve clarity and v;it, are valuable 
goals for any instruction. They are our goals, and things seem to be working 
x^ell . 

One final word • — In a routine discussion of the innovative aspects of 
our instruction, the following topics could very well be mentioned: videotape 
instruction; the v;riMng laboratory; staff training. But these things seem to 
us to be more obvious than innovative. \^o can doubt that there are some 
aspects of our subject that are better handled on videotapes. It is better to 
show people from various parts of the country speaking their regional dialects 
than it is for the instructor to describe regional d^ialects. Linguistic 
behavior in its natural state Is best observed through tl:c window of the TV 
screen. Second, since we have decided that writing is a special problem, we 
have devised spec ial mean^: to treat it. Thi s special means is the Wri t ing 
Lab. There, intensive instruction on writing fs provided on an individual 
and small-group basis. Finally, the staff in tlie x-;riting lab, and more 
importantly, the instructional staff, are wel]-trained specialists in their 
fields. Teaching the primary materials of the course of instruction is not left 
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to general exports with an MA in English, but rather to tiioso \-:ho :\rc hired 
on the basis o. their training in graninar and rhetoric. T:i tdJiiic>n, since 
the inception of the program, staff seminars have been concli:.cl:vd on a 
regular bi-monthly basis. The efforts here, of course, arc m enlar^-^e upori 
the competence that the instructors have, to organi2e a cohLrent program, and, 
in particular, to test the philosophy and the materials c^f th course. "What's 
v;orking?" we ask when we meet. "UHiat isn't working?" "Wliy?" "Wn.at can he 
done about it?'' 

None of us pretends to have found final ansvjor?; to n.iv of vho. import -.^.nt 
questions: "VJliat does a man know?" *'How does he know ii?" "V7l\at-. inay be taught 
"Why and how should it be taught?" But tliese arc question:: th.M h-i\'en't 
been put s^^riously to an English curriculum in 700 years. Our . •:\'-;v;ers are 
broad in that we have large hopes, narrow In tliat v;e stick to cur .^'uibjoct. 
Tt is easy to collect the freshman class in groups of twenty-l ive or tiiLrty 
and then sit around and rap with them about relevance and black rhct.'.oric and 
multimedia and The Great Gatsby , sending everybody hone overy two v;ocks to 
write a theme on the theme of Tlie Great Gatsby . But thnl^r. not a plan. 
That's a rloy. 

Our students like all students are in a \';orld doni n.j t ^ ^.^ V\v ];in>:uaj;e. 
Our plan is to truly equip them to deal xvit]^ tlioLr ]inr',u:>uio i c a oos . 
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LANGUAGE IN THE MIXD: 
A RESPONSi: 

Ferris Antliony'- 

Bill Chisholm was kind enough to provide me with an aJvance copy of 
the paper v/hich he just presented to vou , and also a copy of ::he text currently 
in use in the freshman English program, T spent some interest Lr:f|; and enjoyable 
hours with both documents and, after reviewing these materials, I have formulated 
some critical comments and questions wliich I v;ish to share. Please note that 
I use the term "critical'' in the original G7'eek sense oi' the v.'ord , and in that 
sense it does not mean negative. 

At any rate, it seems to me that Professors Chisholm and Milic and the 
other members of the English Department are to he applauded for developing 
this freshman program. All of us ^ no matter wliat course we teach, if we .^vcr 
require our students to write compositions, are usually disturbed by th? 
general quality of their writing. And it has, therefore, become commonplace 
to remark, "lAHiy doesn't the English Department teacii students how to write?" 
or some variation on this same theme. 

Further investigation into this vjriting problem revea's that the traditional 
approach to English, i-e., the typical freshman ].01 series, was .concerned wi.tli 
grammar and rhetorical skills. Tn short, it dealt with usage, v/hich somehov/ 
was supposed to contribute to writing skills. It has taken us many years to 
realize that a study of usage, especially over a 13-^' ear period, ha.s little 
effect upon a student's ability to v;rlto. S(^, I say again, the English 
Department is to be applauded for a progressive step fovv;ard. 

Second, and more to the immediate point, I find little to disagree with 
in Dr. Chisholm's paper. He builds a strong case for a study about English 
and the work of linguistic scholars in tlvis century has certainly given us 

-Associate Professor, Department, c^f ^-.c'ucation Specialists, Cleveiand State 
Univei.*sity 
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evidence that we do indeed know the rules of the English language by four 
or five years of age. In theory, then, the idea of studying about the language 
seems valid. However, given that a study about language is valid in itself, 
there are still some unanswered questions about the application of this concept 
in the freshman English program. 

First, on a philosophical level, I would like to add several questions 
to those already posed by Dr. Chisholm. Besides asking "What may be taught?", 
"What should be taught?", and "How may it be taught?", I add, "l^Jhat does the 
student need to know?" and "l^^hat are the ultimate goals of our instruction?" 
These questions, of course, are closely related to Dr. Chisholm's, but in this 
form they force us, I think, to examine ultimate goals more closely and to 
define specific objectives more clearly. 

Dr. Chisholm's ansx^^ers to the questions he raises focus on the Subject 
matter itself. I am suggesting that we also need to focus on the student 
and the ultimate outcome of our teaching and the student's learning. 

Second, on a more pragmatic level, I must still raise the question of 
writing. I agree with Dr. Chisholm that writing is an art, but an art, by 
definition, must be practiced — it requires doing. And given the notion 
that the principles of language must precede the development of writing 
skills, the question remains — "liow much research do we have to show that 
a study about language improves writing skills?" 

Is there any conclusive evidence that a study of transformational 
grammar — in lieu of other grammars — will lead to improved writing? 
Is it possible that students may perceive transf ormat iona] grammar, which is 
a complex study, as merely a substitution of one set of rules for another? 
And is it also possible that the first hurdle which we must overcome in 
helping students to imp::ove their writing is Lo eradicate their fear of rules? 




Third, and closely related to this last point, it strikes me th t the 
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text material might be rearranged to capitalize on student interests. The 
first 20 lessons of Section One focus exclusively on the form and structure 
of modern English. Yet it seems to me that students are more likely to get 
excited — or motivated ;^ we begin with a study of propaganda, regional 
or social dialects, or ever, r.i history of the English language. 

The program, as currently planned, '.nay also be more detailed nnd 
complex than is necessary for the average student; and I wonder .if in its 
present form it might be more appropriate for the English major. I^at I am 
asking — in a roundaboui: way — is whether this approach to language snudy 
is the only approach appropriate for all students. I find it difficult 
to defend the concept of a sin gle approach to teaching anything in an age of 
individualized instruction and in an age when many instructors are paying 
more than lip service to the concept of individual differences. 

I am also suggesting tliat , instead of requiring all freshmen to take 
this series of courses, alternative courses (including courses which deal 
with the art of writing) be offered for credit. The student, therefore, 
might be required to take t\jo out of three or three out of four courses, 
including various sections of the current program. Some consideration might 
also be given to the idea of offering the program at a sophomore or upper- 
division level, since there may not be any necessity to limit it to the freshman 
year. In short, i^ it_ more appropr:-ate at advanced levels? 

l^Jhile I am on the subject of alternative approaches, let me raise a 
question about the writing lab. As I understand it, the writing lab is 
currently thought of as an auxilliarv activity and, in fact, it seom.s to 
be viewed as a good and necessary r'cmodial function. Ho!<;ever, I am still 
unclear about the exact nature of the writing lab and about how closely it 
articulates with the entire program. And T am sugger^ting tr-at it might be 
Q appropriate for ail students. 

ERIC 
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This leads me to another consideration; namely, the entire question of 
evaluation. How has the total program, including the writing lab, been 
evaluated? Have students, department members, and ev^n othe'»* departments 
been involved in program evaluation? Has the program met or is it meeting 
its originally stated goals, and what are those goals? 

Finally, there is a question which is tied up in the concept of Black 
English, Realizing the current definitional controversy in this area — i.e., 
whether Black English is, in fact, a unique language, or whether it is merely 
a dialect of standard English — I approach this question somevjhat gingerly. 
There does not seem to be enough evidence at this poiiit to refute or to support 
either position. Howe^'-'M: , if we assume for the moment that Black English 
is a unique language, then ^heiv2 comes a question about the validity, propriety, 
and relevancy of linguistic s.tudy for Black students based upon standard 
English. If, on the other hand, we proceed on the assumption that Black 
English is merely a dialect of standard English, we may wake up several years 
from nov7 and find out that v;e have proceeded on a false set of assumptions. 
I am not sure how we should handle this, hut it seems to me to be a critical 
problem . 

Let me conclude by re-emphasizing that the current program has much to 
recommend it. In mak-ing these comments and in raising these questions, I am 
conscious of my own limitations in this area, but I hope that in raising 
honest questions about the teaching-learning process, we can all come to 
improve the teaching function of this university. 
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CREATING M ALTERNATP.^ LEi^RNIIJO-EIfv^IORNI^IENT IN 
INTRODUCTORY MATHEMATICS 
Richard H. Black* 

The title of this paper may be misleading when it refers to the 
^'creating of a learning environment", a-lternat ? ve or ref. ar, in 
'•introductory mathematics. A mere accurate (and more m.odest) descrip- 
tion: would he "creating an alternative immediate learning environ- 
m.eat" , where "immediate" includes all the things that a.re usually 
consi;- erred controllable (or creatahle) hy tlie instructor (lectures, 
discussions, reading assigiim.ent s , tests, etc.) in contrast to the 
background or "non-imjnediate" learning environment: the other activi- 
ties and influences acting on the student (and also on the instructor), 
both on and off campus. 

I suspect that the relative effect on learning (however measured) 
of the non-immediate environm.ent is greater than instructors will 
usually acknowledge. Or do we acknovrledge only its negative affects, 
which can be used to explain the failure of som.e students in our 
class? In any case, I won't consider the possibility of changing the 
non-immediate learning environment as in the scope of this paper. 
I will not deal with cluster colleges , remedial "how-to-study" progi^ams 
or even the subjects other than m.athem^at ics tha.t our students should 
or should not be simultaneously taking. Hov/ever, you m:ay detect, in 
the description to follow of our alternative i mim.e d 1 a t e 1 e ar n i n g envir- 
onment, an implied recognition and accorjnodat ion to som»e features o:' 
the larger environment. Of course, we have all always done this, if 

^Associate Professor of Mathem.at ics , Cleveland State University. 
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only in a trivial sense: e.g. at CSU ve try to usp some version 
of the English language to convey information, at Tokyo U. we'd 
presumably try Japanese. 

Let me try to describe the regular or conventional learning 
environment in Introductory Mathematics at CSU. Specifically, I 
refer to the sequence of three courses called Mathematical Concepts 
I, II, III; numbered M 135, 136, 137. Tliey have existed since 1968 
as service courses for both Business College majors and Social Science 
majors of the Arts and Science College. That a sequence of math 
courses aimed at this combined group of students is common college 
practice seems to be indicated by the many new textboohs on the market 
with titles such as ^'Mathematics for Business and the Social Sciences" 
or "Mathematics for Management and Behavioral Sciences". I do not 
think there was ever any intention that these courses would also 
serve other categories of students ^ yet they are occasionally taken 
by engineering and physical science majors (for what I consider to be 
strange reasons) and also by humanities majors (for the not-so-strange 
reason that their -science distribution requirements can be satisfied 
by this "lesser-evil" mathematics, rather than, say, physics, chem- 
istry, or a regular calculus course. There has recently been a pro- 
posal in the Math Department to establish a separate "hi^manit ies" 
course for such students). The enrollment in the first quarter, M135, 
has been about 30% Business and ^0% Arts and Sciences. The percent 
of A & S students declines in the second quarter, and the third quar- 
ter is almost entirely Business students. If the present trends con- 
tinue, there will soon be 1000 day-division students taking one of 
these courses each quarter. 
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The subject matter content of these courses can be broadly described 
as an introductory treatment of' 

(1) sets, relations, and functions (the "new math"), 

(2) linear systems ; including vectors , matrices, and linear 
programming . 

(3) probability and statistics, 

(4) exponential growth; for which, depending on the textbook used, 
the exclusive example might be money, i.e., compound interest. 

(5) differential and integral calculus . 

I know that to be in good form "instructional technology-wise" I must 
include in my course description not only content but also the "behavioral 
objectives". I do not think I am being unfair to the math faculty when I 
state that, if asked to give the oehaviorcil objectives of a course, we would 
answer (after the phrase is explained to us) that the student should "know 
uhe material", and for the type of math course we are discussing here the 
evidence that he "knows the material" is the ability to pass a test consist- 
ing of problems that can be solved if one "knov.s the material". This may 
seem primitive to those familiar with more sophisticated and precise state- 
ments of behavioral objectives. I think there is room for improvement. For 
example, we might think more about the exact circumstances and roles in which 
our students will later use mathematics. But some writers on behavioral 
objectives, I have noticed, will grant that in math the objectlvr^s 
are implicit in the material, perhaps even explicit, if, as is ..■.ally true 
with math textbooks, the introduction of each new concept is followed by 
exercise problems for the student; proble^ns that can be solved using the 
new concept. 

The features of the conventional learning environment so far des- 
cribed (content and behavioral obj(-:tives) have not been changed in our 
alternative environ*Qent . We use the same test, and the same type of test 
questions. Even if we were inclined to make a change (and we really 



have not been so inclined) there is a practical reason not to. Some 
students switch from alternative section to conventional section, or 
vice versa , as they progress through the three-quarter sequence. We 
think jt desirable that they can easily make such switches. 

I will now complete my description of the conventional learning 
environment by giving the features that have been changed in our alter- 
native environment. The students are enrolled in sections of 30 to 
120 (Yes, 120 is now-a-days conventional!). If the section size is 
closer to 120 than to 30, it is considered to be 2/3 of the instruc- 
tor's load, and he or she may then also have a grading assistant. The 
class meets the standard four times each week, the time divided into 
formal lecture, further exposition of examples in the textbook, the 
working by the instructor of exercises from the textbook that had 
previously been assigned as homework, short tests, hour tesos, "post- 
mortems" on returned tests. Some interaction of students; with in- 
structors also takes place during the instructor's office hours. The 
percent of time devoted to each of these activities varies with the 
instructor; so do the standards for fina^l grade assignment. There is 
no com^mon departmetital final exam, although occaGionr?.lly two instruc- 
tors whose sections are in the same time block will collaborate on a 
test . 

Rather than follow my now-co^npleted description cf the conventiona 
environment with a similar treatment of our presert winter 1972 model 
alternative environment, I will give an abridged history of the develop 
ment of the alternative since 19^9 » Thank God, no one kept a detailed 
log or diary! The development was certainly not a case of proceeding 
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from original axioris and postulates through rules of inference to a 
logical conclusion. It was more a case of tentative conjectures, ex- 
perimentalism, pragmatism, "tuning up the engine'*, and quite a bit of 
serendipity and opportunism. If I am obliged to state some dominant 
principle that guided us, the best I can think of is one I call "Pave 
the Footpaths" J after a lett er-to-the-editor that appeared some years 
ago in the student newspaper of another campus. That campus had i-'.ome 
new buildings (like CSU), and big expanses of grass between them 
(unlike CSU). A controversy developed about placement of connecting 
sidewalks. The letter suggested waiting until student had worn foot- 
paths in the grass anC then paving them. 

• ^ In spring 1969* Job Egar, Len Bruening, and myself were each asked 
to take a section of 120 students in Math 135 for the coming Fall Quar- 
ter, to be followed by similarly sized sections of 136 and 137 in 
Winter and Spring. At that time sections of 120 were not yet called 
conventional; so "Van" Van Voorhis, then Math Departm.ent Chairm.an, sug- 
gested we might try some innovations. I was then already making some 
experiments with my Math Concepts sections, and the three of us de- 
cided to collaborate, continuing in the same direction as I had started. 

A change from the conventional ought to imply that the conventional 
was somehow deficient. As I have already admitted, we ha^, no qv^v^el 
with the conventional 5 behavioral objectives for our students: that by 
the end of the term they should demonstrate by test that they "know the 
material". But at that time, and even now, I thought that there were 
two respects in which the conventional was deficient: (l) Our students 
vary widely in their pre\-ious mathematics preparation and in the time 
and effort they are willing or able to de\''ote to the courses; yet the 

ERLC 
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conventional section is essentially lock-step; (2) For the magnitude of 
the operation, i.e., enrollment approaching 1000 per quarter, conven- 
tional sectioning is inefficient: a system of "one-room schools" 
where there could be an "educational park", I choose this analogy 
deliberately as one for which I would expect wide (but not \inanimous) 
agreement that increased magnitude made an improvement possible, I am 
well aware that often (maybe even usually) it does not work out that 
way. Now that college textbook publishers have a market perhaps 10 
times greater than it was 25 years ago, are the books any better? 

As to the direction which I said I had already started: I have 
long held the idea that frequent tests are good for the stuc^ent, and have 
put the idea into practice when feasible. I do not remember why I 
first started doing that , but I do recall meeting a math graduate stu- 
dent who reminded me that I had been his instructor vhen he was taking 
an algebra course as a freshman on probation — and he credited my every-- 
other-day quizzes with forcing him to learn and like mathematics. I 
have just read Skinner's Beyond Freedom and Dignity , and this episode 
was an example of a reinforcement (ho me) that might also "be a super- 
stition. 

Egar^ Bruening and I adopted the frequent -test practice, along with 
the practice, borrowed from programmed instruction, of Letting the 
students see the right answers immediately after completing a test. To 
avoid the "lock-step deficiency" we set up a testing room, open h hours 
every day, operated by a graduate assistant and undergraduate student 
proctors, to which the students of all three sections could come at any 
time to take tests. The three instructors all contributed to a large 
pool of test problem.Sj so that problens for a particular concept existed 
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in many versions , and also in three levels of difficulty called "A", "B" 
and "C". Tests could be taken over if the student vanted either to try 
a higher level of difficulty after successfully completing a lover level, 
or to try over again the same or lover level if his first attempt vas 
vinsuccessful . Each student, after checking his ansver vith the 'Vight" 
ones (vhich vere sometimes unintentionally vrong) narked his self-score 
on his test paper before turning it in. These self-scores vere later 
sample audited by the proctors and instructors, much like the IRS 
checks our income tax returns. 

Each of us had our ovn lecture section. Because no class time 
vas used for testing or discussing tests, ve T^ere able to schedule one 
of the four days each veek as an optional reviev session for those having 
difficulty keeping up. 

The first quarter vas considered successful, and the system has con- 
tinued, except for summer quarters, ever since. There vere difficulties 
but they vere alvays considered "technical", not an indication of some- 
thing vrong vith the basic concepts, and ve vould immediately start 
planning hov ve would correct that technical difficulty next quarter. 
I recall that at one of the ITG meetings last Fr?.ll someone cited the 
quarter system as a handicap to innovation. I vould claim our effort 
as a counter-example; an innovation that vas accelerated because of the 
11-veek cycle. 

The technical aspects of the system involved decisions to be made 
on such things as: hov copies of the problems vould be reproduced, vhat 
size and shape for the student's vork sheet, vhere records vould be kept, 
to vhat extent ve should computerize the record-keeping, vhat hours for 
testing and tutoring, vhat could ve do tc discourage procrastination in 
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test-taking, what to do about the newly discovered cheating scheme. 
The decisions were always subject to change after one quarter, and often 
were changed. One firm bit of advice to anyone contemplating trying a 
system such as ours: at least one of the instructional team, and 
preferably all of them, must be willing and able to concern themselves 
with the many seemingly trivial but nevertheless crucial details. 

I will conclude by giving three interesting ways in which the 
system has changed from 1969 to 1972, and some tasks remaining to be 
done. First the changes: (l) We started with the concept of several 
instructors, each with his own lecture section, sharing a testing 
facility; somewhat like a group of doctors, each with their own patients 
sharing a laboratory. We have now altered the arrangement so that each 
instructor is a "specialist'' in one or more "mini-courses" and each 
enrolled student takes all the mini-courses in some order during the 
quarter. In the process we have lost the concepts of "my student", 
"your student", "my instructor", "your instructor". We even encourage 
the students to think of the members of the instructional team as 
interchangeable parts. They can come to the office of any one of us 
for any problems they may have. 

(2) This change evolved froii: the initial arrangement by success- 
ively applying the "Pave the Footpaths" principle. We started with 
three hours per week of lecture-discussions and one hour per week of 
review and "questions from the audience". This has been altered to 
l6 lecture hours per quarter (less than two per week) in a room that 
may have a seating capacity equal to only half the enrolDjnent , plus main 
tenance of a "help" room next to the testing room, open 6 hours every 
day, in which graduate assistants, undergraduate assistants, and 
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sometimes the professors, vill discuss any material of the course at any 
time vith any students that come there • The discussion is '^laboratory 
style" with the assistants walking around the room to vherever students 
are seated or standing. 

Instead of talking to one of the assistants, some students prefer to 
just look at material previously written on flip-chart sheets hanging on 
the walls or to start an ad-hoc "peer-group discussion". The room is 
open, incidently, to students in other math courses. 

(3) We started with the test problems divided' Into the A, B, and C 
levels of difficulty, with the final letter grade determined hy hov many 
of each level the student has successfully done. We found that of the 
students who got a final grade of B, more got it hy accumulating a just- 
sufficient partial set of A test grades than got it hy accumulating a 
larger just-sufficient set of B test grades. This and other results, 
led us to two conjectures: (l) that a "Law of Minimum Effort" was 
governing most students. They tend to obtain the grade they get in 
whatever way requires the least effort. (2) that the "real levels of 
difficulty concerned how many single-concept tests (of whatever supposed 
difficulty) a student could pass during the quarter, and how many con- 
cepts the student could handle simizltaneously in a multiple-concept re- 
view test. We abandoned the A, B, C test in favor of a three-stage hier- 
archy of 16 single-concept pass-fail tests (one for each of the 16 
lectures), 3 or 1+ multi-concept review (or chapter) tests, and the final 
examination. The requirements for final grades of C, B, and A are 
cumulative, involving, respectively, only the single-concept tests, 
single and multiple and final exam. The final exam is "by invitation 
only" to the "candidates for an A". 
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Now some tasks remaining to "be done: (l) I feel that the live lec- 
tures, the only vestigial lock-step feature of the system, should be 
eliminated completely. The department has already purchased some com- 
bined magnetic audio player-slide projector equipment with vhich we 
hope, by next Fall Quarter, to have a "canned" version of each lecture 
that would be available to students for individual or small-group study 
at any time either through the CSU Librai*y or our Help Room. 

(2) If this alternative learning environment becomes stabilized in 
its technical details and remains acceptable to the department, its 
quarter-by- quarter operation should be deliberately made non-dependent 
on particular personnel. My previous experience with a university com- 
puter center makes me all too aware of the danger of coimnitment to a 
complex system if there is not such non-^dependence . 

(3) An analysis of the system should be made as to its effect on 
students compared to the effect of a conventional system. This would 
include both terminal performance comparison and also attitudes of 
students toward both systems. We have done some comparison of final 
grades, and we know from unsolicited comments that an instrument that 
could record student at-^.itudes toward our alternative system would have- 
i-^s indicator needle go off both ends of the usual "strongly-disagree" 
CO "strongly-agree" scale. But much more could be done. It would be 
useful to know, for example, if the students who strongly disagree or 
strongly agree could be predicted from other of their characteristics. 

(1+) Finally 5 the effect of such a system on the faculty should be 
investigated. I gather that efforts similar to ours are proceeding on 
many campuses. Some of the practitioners have predicted or advocated 
drastic changes in the roll of teaching faculty as a result of such inno- 
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vations. I see a chance for cause and effect to be reversed; a chance 
for such innovations to be a result of a role that teaching; faculty choose 
for themselves from among several roles still possible. 
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CREATING AN ALTERNATIVE LEARNING 
ENVIRONMENT IN INTRODUCTORY MATHEMATICS : A RESPON$:.^E 

Frank Lozier'^ 

First, I'd like to expand on Dr. Black's remarks about the 
i)ehavioral objectives of math courses. He is perfectly correct in 
saying that the behavior used as a basis for assigning grades is the 
working of problems. However, it should be pointed out that there 
are two kinds of problems which might be used for this purpose. One 
is the "cookbook" problem, i.e., a problem essentially the same a^^ 
one the student has already worked or seen worked. The other is a 
problem which may be completely unfamiliar to the student, but which 
can be solved using only the material which has been presented in this 
course. Now most of us fancy that we grade our students on the basis 
of whether or not they understand the material presented in the course, 
and would agree that the second kind of problem affords the best measure 
of this understanding. In fact, however, most of us grade on the basis 
of the first kind of problem. This discrepancy is easily explained 
in terms of Dr. Black's most recent grading system. His single-concept 
tests consist of problems of the first kind while his multi-concept 
tests, which must be taken to earn a ? or A, consir.t of problems of 
the second kind. Dr. Black's grade statistics show that nearly 70% of 
his students receive a C or less- Therefore, one can conservatively 



^Associate Professor of Mathematics, Cleveland State University 



-121- 

estimate that if he used only multi-concept tests, more than half of 
his students would fail. This situation is not peculiar to Dr, Black's 
system* To put the matter bluntly, most students in beginning math 
courses do not really understand the material, and we accoraraodate our 
grading practices *;o this reality. Now, I for one, would applaud anyone 
who devises an "alternative learning environment'' which alters this 
reality; such, however, is not Dr. Black's objective. 

In addition to the terminal behavioral objective discussed above, 
I suspect that most of us have other behavioral objectives in mind when 
we teach. Math instructors differ much ^re in the latter than in the 
former. One may, for example, attempt to exert some control c /er the 
students' objectives. In this respect, insi:ructors vary considerably. 
Some try to force students to learn. Others merely try to provide the 
best possible opportunity for learning. Still others sympathize totally 
with the students' desire to get a grade. Furthermore, instructors 
who worry about whether or not students learn vary considerably in the 
extent to which they try to control how students learn. In math courses 
in which the basic objective is the working of pattern-type problems, 
students generally learn by attempting to work problems, comparing their 
solutions with the correct solutions, and doing this over and over again 
until they are able to work the problems correctly. Math instructors 
vary in the extent to which they try to force students into this mold. 
Some assign homework and collect and grade it. Others assign homework 
and provide the correct solutions only after the students have had a 
chance to try to solve the problems themselves. Still others pass out 
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sets of solutions to a selected list'of problems at the beginning of the 
quarter and let the students do with them what they will. 

It seems to me that the very structure of Dr, Black's -system reveals 
a conmiitment to force the students to learn and to control how they do it. 
He gives a large number of short tests, admittedly for the purpose of 
forcing students to learn. Also, although he wishes to allow students 
to decide when they are ready to take exams, his system has built-in 
constraints to prevent them from waiting until the end of the quarter 
to take all their exams. Finally, he permits students to retake tests 
until they pass them, thus building the conventional learning model 
into the exam system itself. My prejudices, on the other hand, are at 
the other end of the spectrum. I try to structure my courses in such 
a way as to maximize the opportunity for learning but to exert no control 
over it; when time, permits I pass out sets of detailed problem solutions 
which the students may use as they think best. Thus, it must be 
apparent that the difference in our educational philosophies puts me 
considerably out of sympathy with Dr. Black's system. Of course, so 
long as we both run our o\^m courses, this is purely a matter of personal 
preference. But, if at some time the math department should decide to 
adopt a system for the servicing of all students in some sequence, s:uch 
as basic math, then it would Iiave to decide, ar^ a matter of policy, hcv 
its limited resources of time and money should be expended. 

Finally, I would like to comment tipon Dr. Black *s claim that his 
system nearly eliminates the lock-step icrent in conventional courses. 
Lock--step means, I presume, that all students do the same thing at the 



sama time. From Dr. Rlack^s remarks, I infer that he is thinking primarily 
about the "same-tine" lock--step. I confess to reservations about vrhether 
he has really eliminated it- In the fi^st place, while Dr. Black's 
system allows students considerable freedom in deciding when to take 
e:-?f7/is^ this appears to me to be a freedom to choose when to do tasks 
that in a conventional system one is not required ..o do at all. To put 
it another way, I would find it much less oppressive to take a few exams 
at scheduled times, than to take 20 exams at times of my choosing. 
Furthennore, Dr. Black is still bound by the quarter system. Good 
students could complete the requirements of Dr. T^lack's system in less 
than a quarter, but what are they going to do with the rest of the 
quarter? Poor students, on the other hand, must still complete the 
requirements by the end of the quarter; how many such studer.ts r.iKn 
profit by working at a slower pace at the beginning of the quarter and 
then working at a necessarily accelerated pace during the rest of the 
quarter? However, one must grant that, if the administration ever makes 
it possible for us to award credits other than at the end of each 
quarter and then only in amounts contracted for at the beginning of the 
quarter. Dr. Black would be prepared to take advantage of this freedom 
as none of the rest of us are. 

Dr. nlack says little about the "same-thing'' lock-step. F>ut the 
feature of his systerr. which is most attractive to me is that it does in 
fact, reduce this kind of lock-step. In designing exams for a conventional 
course, one can use only simple problems, in which case one gives A's 
primarily for outstanding accuracy in arithmetic and algebra, or one can 



use only difficult problems, in which case one grades all students on the 
basis of how close they can come to solving A-lcvel problems. Even an exam 
consisting of problems of varying levels of difficulty has much the same 
effect as an exam consisting of all difficult problems, because it is 
;iT.;possible to convince poor students that they should concentrate on 
the easy problems; all students study for and atte:^pt to do the hard 
problems, which for many of them is a waste of time. Black's system, 
while giving B^s and A's only for the working of more difficult problems, 
allows C-students to earn their C's by concentrating on problems they 
are capable of doing. I suspect that poor students learn more under 
such a system than under one which encourages then to concentrate on 
problems they are not capable of doing. 



THE CONTINUOUS FEEDBACK METHOD OF TEACHING 
Sam H. Lane 



The purpose of the present paper is to present a teaching technique, 
the "Continuous Feedback Method" , and its rationale. This paper is a 
first statement of some developing ideas which should be considered as 
guidelines rather than a complete and proven model or theory. The 
technique is designed to approach several objectives that are difficult 
to achieve. The primary objective of the method is for students to 
increase general skills requisite to efficient coverage, integration 
and synthesis of written material. A corollary to the primary objective 
is that those students who increase their skills only at a minimal level 
still will have learned the content of thj course as well as a student 
who has been exposed to the material in a more traditional manner. The 
primary objective probably does not differ a great deal from the primary 
objective that most teachers x^70uld set for their courses; but the 
Continuous Feedback Method does prescribe a somewhat different formula 
for its attainment. 

The skills involved in the primary objective are strengthen^-d through 
a shaping procedure in which the initial responses are simple approximations 
to the later, more complex responses. This gradual evolution of more 
accurate and complex responses follows certain principles cf learning. 
There are three critical aspects of the shaping procedure: response 
production, the consequences of the response, and the time between the 
response and its consequences. The efficiency of the shaping procedure 
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is increased by arranging for many rGsponses, minimizing the time between 
a response and its consequence, reliably reinforcing those intermediate 
responses that are closer approximations to the desired response, and 
omitting reinforcements (or, in fact, punishing) for intermediate responses 
that are not cloFur to the desired response. 

These aspects of the shaping procedure are germane to the general 
problem of getting students tr learn in a classroom situation. In most 
courses taught in a traditional manner (especially in large classes), the 
rate of response production is equal to the number of quizzes and papers 
assigned in the course. In such a case, both the low rate of response 
production and the substantial delay in the receipt of the consequence 
by the student have a debilitating effect on learning. A "response", in 
terms or a student listening to a lecture and taking notes, is assuTied 
to be qualitatively different from the response made when information is 
requested for immediate evaluation by the professor; neither does it 
have the same effect on subsequent behavior. In the former case, the 
process of information storage is primarily involved whereas the latter 
case involves information storage, retrieval, organization, production, 
and reorganization based on feedback. 

The first step in increasing the efficiency of the shaping procedure 
described earlier .!.s to increase the rate of response production. The 
major difficulty with increasing the rate of response in most courses is 
that a student's motivational level is usually a function of his inter- 
action with the grading system. In other words, most students have been 
conditioned to do things because they are going to get a grade for it. 
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Therefore, at least initially, their rate of response production will be 
a direct function of the probability that their grade will be affected by 
what they do. 

Using the Continuous Feedback Method both the rate of response 
production and the motivational level are kept at a level appreciably 
higher than it would be using most other approaches. The students are 
told that there will be no written tests and no papers. Their grade 
will be assigned solely on the professor *s cumulative evaluation of their 
day-to-day performance, thus a high level of class attendance is required 
Class time is spent discussing and answering questions about the material 
Thus, during any one class, each student makes one, if not several, 
responses that he knows will go toward his overall evaluation. The high 
rate of response production is accompanied by the immediate application 
of a consequence relevant to that response. Since he does not know in 
advance exactly for which material he is going to be heOt i accountable, 
he must "know" the entire assignment. 

To some extent, what has been described thus far is similar to the 
"case method" frequently used in law schools. The Continuous Feedback 
Method, however, is designed primarily for use in classes with an 
enrollment of 30 or less. The case method is generally used in large 
classes so the rate of response production is rather low, even though 
somewhat similar motivational factors are present and the tir.e between 
the response and its consequence is minimal. Another difference is that 
the Continuous Feedback Method is based on the notion that attaining 
integration involves a complex shaping procedure: initially responses 
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are only simple approximations to .the more complex desired behavior. 

The initial unsophisticated and later maturer responses are qualitatively 

only minimally different using the case method. 

From my experience, I have identified roughly three sequential 
phas s that most students go through in the shaping procedure. The first 
phase consists of two complementary components: establishing a high level 
of response production and developing personal strategies for recalling 
specific aspects of written material. A high level of response production 
is shaped by positively reinforcing daily class preparation and mildly 
punishing a lack of it. Class time is spent shaping the recall of rather 
specific and detailed pieces of information. This is the first approxi- 
mation to the more complex responses involved in efficient coverage, 
integration and synthesis. 

At first, the students are somewhat confus,ed. They feel that "they 
have- to memorize everything in the book". This feeling, coupled with 
the necessity for daily class preparation, leads most students to design 
personal strategies for remembering what they have read. Some class 
time is spent in going over aspects of remembering and forgetting and 
discussing possibls stra-Lugies . Students r^.-fe encouraged to share 
personally successful strategies with the class. 

The second phase toward reali2:ing the primary objective of efficient 
coverage, integration and synthesis involves identifying and assimilating 
relationships between various bits of specific information. Retention 
is not such a great probi^im any more, even though it still requires a 
considerable ainount of practice^ In this phase, it is not sufficient 
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merely to recall specific pieces of information as was initially the 
case. Positive reinforcement is received only for using the specific 
information to identify relationships • Substantial communication among 
class laembers is encouraged at this point in order to allow the students 
to practice in a more relaxed perspective. These discussions usually 
foster a substantial amount of student-to-student shaping. In addition, 
they provide a diversion from the question-and-ansv;er format. 

At this point students find that material can be discussed cogently 
in the class group because they are sure that the material has been read 
by everyone in the class. The efficiency of the discussions is enhanced 
by emphasizing the distinction between clarification and evaluation of 
what he said. 

In the third phase, the class discussions and questions are designed 
to shape the student's involvenent with larger ''chunks*' of information, 
optimally relating the material in a chapter as a whole to previous 
material. Also, the student is encouraged to respond to questions with 
full answers involving examples that not only directly onswer the 
questions but also show that he has a relatively complete understanding 
of the issues involved. A demonstration of these things is indicative 
that the student has achieved the prir ry objective of the method. 

The shaping procedure described above T%n.ll not uork unless seme 
attention is devoted to group maintenance. In particular, the level of 
anxiety for individuals as well as the over-all level of tension must be 
monitored closely. At a high level, individual response production is 
reduced and there is a general air of inhibition induced by anxiety. 
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There are several aspects of the design of the class which are addressed 
to this point • Throughout the first weeks an instructor should emphasize 
the proper perspective for the course is that of a game of information 
and that any punitive feedback should not be perceived as personal but 
should be considered as part of the instruction. To some extent, this 
idea is made more credible as students see that everyone in the class 
receives such feedback from time to time. 

An effort is made to keep the class atmosphere as casual and informal 
as possible without confusing this casualness with attitudes toward the 
material. On the first day of class a simple child's exercise called 
"the name game" is played to acquaint the students with one another 
and to provide a vehicle for the professor to kno\^; everyone's name in the 
class very quickly. In this game the first person will say his name 
(first name only) follctiv-ed by the second person repeating the first person's 
name and then saying his om. This goes on around the room until the 
last person calls everyone in the room by name and then says his own 
name- Usually this is followed by a hue and cry for the professor to do 
likewise, x^hich perhaps surprisingly, is easier than it may sound, even 
for the worst "name-f orgetter'' . 

The professor must be attentive to the progress of Individual 
students. If a student perceives himself as doing poorly he will sometime 
withdraw and become isolated. Tr.is indicates that one or more of the 
shaping parameters have not been effective. Usu-illy the problem is that 
the distance between the approximating responses is too great. Withholding 
a positive reinforcement or administering a mild punishment to the 
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response eventually results in response inhibition. In most cases a 
personal conference with the student which sets up some individual 
shaping schedules solves the problem, A personal conference is also 
appropriate when the shaping procedure precipitates an extraordinary 
amount of aggressiveness in a student and he fights too much. The 
students have to believe that the professor is not "out to get them". 

As noted earlier, the students are told on the first day that their 
grade will be based solely on the subjective evaluation by the professor 
of their day-to-day performance. They are also told that if they do 
high quality work from day to day they will receive a grade of "A" 
(on an A, B, C, D, F grading system). If they just keep up they will 
receive a grade of "B" and if they don't they will get a grade of "C" 
or lower. Students, whose pattern of attendance and preparation suggest 
that "they are not keeping up, usually drop the course of their own 
volition. In those cases when a student appears to be on the borderline 
between "C* and ^^D" work, he is counseled to that effect approximately 
two-- thirds of the way through the course, thus giving him ample opportunity 
to bring his grade up. 

The greatest cause of negative arousal on the part of the student 
is receiving a grade that is contrary to his expectations • This probability 
is reduced by the day-to-day feedback that the student obtains. Over the 
course of the quarter, the professor's standards become explicit, thus 
reducing one source of potential confusion. Also, there appears to be 
a subtle shift from responses controlled by the extrinsic motivation of 
a grade to responses controlled by a combination of intrinsic motivation 
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and extrinsic motivation related to a social norm established by a close 
peer group of an individual "doing well" , regardless of the grade he 
receives. Several other precautionary steps are taken. Half-way through 
the course a written statement is given to each student appraising him of 
his progress thus far and the grade he would receive were It the end of 
the course. Also, at the end of the course, each student anonjnnously 
gives each other student the grade he thinks the student would receive. 
This provides additional information to the professor regarding the 
general expectancies of the class of overall and individual performance. 

With such a subjective grading system, there is always the possibility 
that a student will feel that he has been treated unjustly. The ratings 
by his class members can serve to validate the professor's assignment 
of grade. As an additional step to prevent this from occurring, the 
students are told on the last day of class that if they disagree with 
their posted grade that anytime within a 3-day period after it is posted, 
they may take a comprehensive written examination to demonstrate their 
level of competency. It is explained that if they really have been 
keeping up (in the case of an argument for a "B") or keeping up and 
doing high quality work (in the case of an argument for an "A") they 
should be able to reflect that level of ability on the exam \'7±th little 
need for much advance preparation. Thus far, no one has asked. 

The strategy by which a professor makes decisions about the assignment 
of grades in such a system is an individual matter. I have found it 
useful to define initially the "A'' category by the best student in the 
class and keep adding students until the differences between the most 
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recently added student and the best student are too great to warrant the 
classification. 

The effectiveness of the Continuous Feedback Method can be evaluated 
from several different standpoints. Generally positive student reaction, 
as indexed by both formal course evaluation forms and informal essays, 
may be sum^ied up as follows: (1) this was the first course they had had 
in which they had to prepare each day and they found the experience both 
demanding and stimulating; (2) they had to work harder in this course 
than in other courses; (3) it was one of the few cours^es in which they 
felt that the professor was interacting with them personally; and (4) 
they felt that they learned more with this method than with a more 
traditional method. ?^egative reactions generally have taken the form of 
criticisms of aspects of the shaping procedure which were particularly 
crude during that particular quarter but were modified based on the 
feedback, or reactions reflecting consequences of not monitoring the 
level of individual anxiety and group tension. Valid objective data 
regarding the "amount" that a student learns in any course are always 
difficult to obtain. With the Continue us Feedback Method the most 
encouraging data would show that students coming out of this course did 
better in later courses than a matched sample who had not had the course. 
Thus far, obtaining such data has not been feasible* It can be argued, 
however, that an individual is learning more, both in terras of skills 
and content, in a situation in which he is making many motivated rei'sponses 
and obtaining differential feedback than in a situation in which he is 
making fev? motivated responses and obtaining limited feedback. 
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I have used the method in courses ranging from the sophomore through 
graduate levels of training and I have found that students from the 
junior level on seem to be able to derive the greatest benefit from it. 
The method seems to be appropriate for most areas of content. The 
technique makes rather strong demands upon the teacher as well as the 
students. He must be relatively ' ap" for each class and be very attentive 
to the day-to-day dynamics of the group. He must be prepared to be 
flexible and adjust the technique to his own particular style of 
interacting with students. In return, I think that he will find himself 
experiencing an exhilarating pedagogical experience! 



-135- 

THIRD FORCE EDUCATION: A COURSE IN PERSONAL GROWTH AND DEVELOPMENT 

C, Kenneth Simpson * 
Mary Ruth Shaw + 

It has been said that we live in a 'sick society' and that terms 
such as the psychopathology of the average, normal neurosis, and philo- 
sophical neurosis can be applied to a large segment of the population. 
Most of us am only too familiar with the myriad problems which besiege 
us, threatening directly and indirectly from all sides. Daily the mass 
media present vivid accounts of war, crime, pollution, and many other 
societal problems. We are less aware, however, of the psychological 
effects which these have on all of us. Modern man has been described by 
some of the most eminent psychologists and psychotherapists of our time 
as dehumanized, alienated, insecure, anxious, lonely, conforming, and 
not very happy. The picture, to be sure, is depressing. 

Theoretically, the powerful and established educational institution 
could have a tremendous influence on the solution of many of these problems. 
Unfortunately, however, the ills of society also appear throughout most of 
education. The story is summed up succinctly by Abraham Maslow (1968b) 
who asserted > "Our conventional education looks mighty sick*', but it is 
told in disheartening detail in books such as Silberman's Crisis in the 
Classroom ; The Re makin g of American Education , Taylor ' s Students Without 
Teachers : The Crisis in_ the University , Goodman' s Compulsory Mis-Education 
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and Tha Community of Scholars, and Leonard's Education and Ecstasy, to 
mention just a few. 

In an atmosphere which is too often impersonal, threatening, and 
growth-inhibiting, our country ^s valuable young resources are exposed to 
a fragmented education which is frequently irrelevant and meaningless to 
them. In an educational setting which promotes values such as success, 
competition and consumption, our students are being molded in assembly- 
line fashion to be well-disciplined robots who defer appropriately to 
authority and conform voicelessly to the establishment. In classes which 
focus almost exclusively upon intelj actual-cognitive development, our 
students acquire the abilities to memorize and recall so that only a 
part of the individual, his head, is prepared for only a part of his 
life, his job, or career, while his personal-social-emotional development 
is woefully neglected. 

The recent development of third force education (Goble, 1971), in 
conjunction with humanistic psychology, the hum.an potential movement, and 
laboratory training, represents one very important step towards improving 
th€i current educational situation. By providing a new philosophy, a new 
psychology, and a new methodology, these areas cvfer solutions to many of 
the problems we have just described. They provide the atm«"sphere and the 
ingredients necessary for an effective, well-founded education which meets 
the needs of the Individ jal and contemporary society. Moreover, they 
provide the opportunity for t:>e individual to develop psychologically so 
he cp.n actualize more of his unused potential and lead a happier, more 
meaningful life. 
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Third force proponents point out that education can be "ecstasy'' 
when relevant and raeaningful materials arouse curiosity to high levels 
of excitement, when tlie student is free to Icam in the more ideal 
atmosphere of trust, affection, and mutual respect,, and when he is an 
integral part of a learning community facilitated by an authentic 
teacher. That same education can accentuate individual expression, 
expanded avjareness , the dignity of man, and fulfillmnnt of individual 
potential. It can facilitate human interaction by emphasizing values 
such as cooperation, deep encounter-, and brotherly love. ?*y stressing 
personal-social-emotional development, it can help him learn 5iome of the 
most important thinp;s in life — how to love, feel, sense, be spontaneous, 
be happy, develop his identity, relate to liis fellow man, and live life 
more fully. 

To reach these objectives, third force education strongly emphasizes 
training in several specific areas: personal growth, interpersonal 
relations, group dynamics, and organizational development. Thus, Egan 
(1970, p. 13) comments, "Human relations training is perhaps the most 
important kind of learning but it is the raost no.glected.. Perhaps it is 
presumed that such learning occurs naturallv outside of the classroom. 
Most often, it does not; therefore, the majority of persons reach adult- 
hood without being self-actualized in an interpersonal area.'^ The 
importance of such learning is also stressed by Peterman (1972) who suggests 
that v/e build interpersonal skills training prc,^rams into our educational 
system. 

Currently these training urograms and courses are beginning to 
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appear as part of a new ideology I'hich is attempting to promote 
psychological growth directly through educstional courses (Alschuler, 1969) 
Clark (1971) observes that the techniques of the human-growth potential 
movement have begun to appear in Sf:hools all over the country. In 
particular, there has been a remar'.cable increase in intensive small groups 
on our college campuses (Shaevif: and Barr, 1972). 

An integral part of many training programs and courses is the 
laboratory training group, a powerful and effective raethodology (Buhler 
and Allen, 1972) which is ideally suited to the goals of third force 
education. Rogers (1970) has called the encounter group, one of many 
diffcarent kinds of laboratory training groups, the moT/t potent social 
invention of the century. It is suggested by Shenard (1970) that personal 
growth labs can function as a refjocializing institution to unlock our 
mechanistic culture and help build a better society. Morris et^. al. 
(1970, p. 192) assert that the T-group "fairly explodes with antidotes 
for what ails higher education,' and Thomas (196A) makes the point that 
the group experience can facilitate the growth of the individual towards 
self-actualization . 

Utilizing the encounter group methodology we have designed during 
the past year a course entitled "'Personal Growth and Development," t!\e 
primary objective of which is the personal-social-emotional growth of the 
student. Our purpose liere is to describe the anatomy of this course in 
order to provide general inf oT.-mation to some readers and more specific 
information to others who have already developed or '-iho may be 
developing a similar course of their o\m. VJe shall also suggest several 
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applications of this methodology to other educational situations. 

The Personal Growth and Dcvelopninnt Course 
VJe might preview our later discussion by presenting a capsule 
summary of the course: 

Psychology 46 7 ^ Personal G rowth a nd Development , is a course which 
focuses upon the interpersonal and intrapersonal growth of the student. 
This growth is based on experiential learning derived from participation 
in an encounter group v/hich is enhanced '^.onsiderably by extensive 
cognitive learning. The encounter groups meet in v;eekly fcair-hour 
evening sessions and for two three-day weekends during t'' c; quarter. 
Didactic sessions, both lectures and discussions, are scheduled during 
regular class time twice a week. Input to the professor is required 
through individual reaction papers, to group sessions, application 
assignments, task group assignments, and periodic questionnaix.es. Within 
this format, students have every opportunity to fully know and under- 
stand :heir experiences, the result of which is greater learning, longer 
retention, and more effective transfer of the general principles to 
everyday life situations. 
The encounter ):yroup methodol ogy 

An encounter group is a small group of individuals (usually 8 to 
18) who meet with one or tv/o "leaders,'* Utilizing, basic processes of 
self-disclosure, feedback, and expression of feelings, members of the 
group interact personally in the here and now to learn experientially . 
The groups are usually unstructured: there are no predetermined goals, 
no pre-programmed direction, and no leadership in the traditional sense. 
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Rather, the group members provide the data and resources for learning as 
they come to assume responsibility for themselves and the group as a 
whole. In the context of a psychologically safe environment, various 
personal and interpersonal issues arise from which each person can grow 
as he explores himself, makes decisions about desired changes 5 and 
subsequently experiments with new behavior. 
Principles of progr am jd e s i^r i 

The design of the course is based on a number of important principles 
which are beginning to appear throughout the rapidly increasing literature 
in the field of laboratory training. Extracted mostly from research 
studies, theoretical articles, and papers which criticize laboratory 
training, these principles provide major themes which appear repeatedly 
in the different facets of course design. Some of tli^se have general 
application to mos^ laboratory training programs; ot!icrs are specific to 
this course, representing idiosyncratic preferences rather than indispen- 
sable requirements. 

Briefly, and succinctly stated, they are as follows: (1) The 
program is conducted by qualified leaders. (2) Applicanf^ are carefully 
screened before being admitted to the course. (3) A psychologically 
safe environment is evolved as the context in which ^:?rsonal growth 
occurs. (4) As far as is possi])le, the metliods u .d are supported by 
knowledge, theory, and research in the field. (i) The experiential 
learning is supplemented and greatly enhances jy a considerable amount 
of cognitive learning. (6) Learning and personal growth are heavily 
stressed. (7) There is a strong e^nphasis on transfer of learning to 
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everyday life situations. (3) An optimal, but miniinal, aiTiount of 
structure is utilized to facilitate group development and maximize 
personal learning. (9) Exercises are employed in an appropriate 
manner, (10) The program is long enough to enable students to acquire 
a substantial amount of learning and to work through any issues which 
arise. (11) The program has built-in methods of obtaining feedback 
from students about the course as a whole, specific aspects of the course 
and the leaders. (12) The course is associated v/ith an on-going 
research program. 
Course objec tives 

As in most laboratory training programs, the range of objectives and 
personal growth goals in this course is extrenely broad and includes many 
different facets of human experiencing. Generally, however, we can divid 
these into twc categories, interpersonal f^rovjth goals and intrapersonal 
giowth goals. Interpersonal grovjth refers to thos^ leam.ings which are 
concerned with interpersonal relations and wliich are derived primarily 
from interaction with others. Intrapersonal growth refers to those 
learnings which focus on the individual himself and which are acquired 
predominantly by his working alone on himself. 

One set of interpersonal growth goals can be found in the work of 
Egan (1970) who provides an excellent description of what we call 
"specific behavioral skills:" listening, self-disclosing, expressing 
feelings, giving and receiving feedback, giving and receiving confron- 
tation, and giving support. Another set of interpersonal goals consists 
of those which are pursued in most laboratory training groups: learning 
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about I'foup dynamics and group processes; de^^^loping sensitivity to 
others; learning to function effectively as a group member; learning 
about personal communication problems; learning how to communicate 
clearly; developing deeper, more meaningful relationships with others; 
relating to authority figures; relating to the opposite sex; learning 
to enjoy people and social interaction more; developing acceptance of 
others, empathetic understanding, and "brotherly like; ' and acquiring 
knowladge about people in general, 

The major intrapersonal growth goals aro based on Maslow's (1968a, 
1970, 1971) conceptualizations of mental health, human motivation and 
psychological grovith. They include the general process of self- 
actualization and more specifically the many characteristics of the self- 
actualized person. Overlapping somewhat with these are other goals which 
are stressed in many laboratory training groups: developing self- 
awareness, self-insight; acquiring greater self-knowledge (about facades, 
defenses, personal problems, weaknesses, strengths, goals, values, and 
potential); developing self-confidence, self-esteem, and self-love; 
developing a stronger sense of identity; becoming more aware of one's 
real self; developing greater authenticity; developing sensitivity to 
oneself (senses, bpdy, feelings, thoughts); and icfirning to experience, 
recognize, label, and express feelings. 

These different sets of personal growth goals are presented 
explicitly to the student in several ways: in the detailed course 
description which he reads before applying for admission, in the Laboratory 
Training and Personal Growth Manual , and in the ore-questionnaire vzhich 
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he fills out at the beginning □£ ^^le course. Thus, the student is well 
informed about the nature of the profrram prior to ref^istering and aware 
of the potential range of goals which he might pursue later when the course 
begins. Through this kind of structure and goal visibility, wasteful 
and inefficient design is eliminated , thereby facilitating the learning 
process (Egan, 1970) • 

However, unlike the r,oals in traditional academic classrooms, the 
goals in a laboratory training group are not the same for all students 
nor are various educational activities pre-programmed to work towards these 
goals. Each individual has the responsibility of freely choosing according 
to his o\'m needs and interests the goals he would like to pursue. More- 
over, most group sessions arc not pre-planned: what occurs is determined 
by the particular collection of unique individuals who compose the group 
and the free-flowing dynamics of human interaction. 
Leadership s tyle 

The leadership style employed by the trainer strongly influences the 
quality of the experience for tha participant. In vzhat is probably the 
best series of studies available on encounter groups today, Lieberman 
(1972) demonstrates quite clearly the differential effectiveness of 
various trainer styles. Sone produce a high degree of learning and 
growth, some result in very little leaminp,, and others nay be associated 
with negative outcomes and psychological casualties. Since these styles 
vary tremendously from person to person, both between and within training 
methodologies, it is important to present, in any program description, 
information on the particular style used. 



In these groups the trainer functions in four ways. As a leader- 
member whose job it is to serve the group, he ^guides ' the group when 
necessary to facilitate group development and personal growth. More 
specifically, this function is that of a social engineer. As a valuable 
group resource, he draws from his wealth of knowledge, experience, and 
skill to provide the groiip , Hoth voluntarily and upon request, with 
information, insi£;ht, and interpretation. As a model, he provides one 
example of an array of different behaviors whiJi group members may wish 
to develop. As a member of the group, he is nr> individual who shares 
himself personally with others (although there are certain limitations 
to this). 

The four dimensions of leader behavior presented in the Lieberman 
study provide another useful way to describe the leadership style. On 
the basis of trainer self-report, reports of other trainers and co- 
trainers, and participant ratings, the leadership style can be described 
as moderate on the emotional stimulation dimension, high in caring, high 
in meaning attribution, and moderate in executive functions. This 
profile describes the Type B leader, the Provider, xjho , Lieberman states, 
is "by far the most effective in producing positive changes while 
minimizing the number of participants who had negative outcomes'' (1972 , 
p. 160). 

Screening^ proce d ures 

Reports of casualties and negative outcomes have increased ^long with 
the increase in the number of laboratory training groups conducted. 
Examination of the literature in this area, however, reveals that the 
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incidence of pathology is low when sponsors are reputable, competent 
organizations and the leaders are trained (Reddy, 1972). Since most 
laboratory training groups are intended for "normal'' people with "normal" 
problems and not as quick or inexpensive therapy, it is desirable to 
utilize a screening process to deselect individuals who might be 
casualties or who might not othen^ise benefit fron the experience (Yalom 
and Lieberman, 1971). 

Every student interested in takin?^ the course is required to go 
through the screening procedures and obtain v/ritten permission before 
registering. To be reasonably well-informed about laboratory training 
groups in general and this course in particular, each student is asked 
to read a detailed course description and several short articles on 
groups. If he then wishes to be considered for the course, he is asked 
to fill out a two part application form. The first part is composed 
of short answer essay questions which inquire about* his knowledge of 
encounter groups, expectations, personal goals, and previous psychiatric 
and medical history. A second questionnaire is designed to collect 
information about his environment , attitudes about himself and others, 
and behavior in interaction with others, vrnen the questionnaire is 
returned and examined, tlie student is scheduled for a thirty-minute 
group interview during which time his behavior in a new group situation 
is observed. The final selection and deselection processes are based 
on a number of criteria which are iust beginning to appear in the 
literature (Lakin, 1972; Roddy, 1972). 
Gr o up composition 
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From the twenty-four students admitted to the course, two groups 
of twelve persons, six males and six females, are formed; U'ithin the 
limits of this sampling from a college population and in accord with what 
is thought to be a desirable group composition strategy, the groupr are 
heterogeneously composed. Each group has a trainer (the professor) 
and either a co-trainer or student co-trainer, Tlie co-trainers are 
students who have completed an intensive training program entitled 
Psychology 310-Leadership of Laboratory Training Groups, The student 
co-trainers are individuals who are participating in the training program 
and working with the course as a part of that training. 

Course requirements 
Experiential lear ning -_the enc ounter g roup sessions 

The major part of the course consists of participation in an 
encounter group x^hich meets regularly throughout the quarter. In the 
schedule of group sessions which vje have used most recently, students 
attend a four-hour evening session each week^ a three-day weekend 
scheduled for the fourth week of the quarter, and a four-day weekend 
scheduled for the eighth week, thus totally approximately eighty hours 
in encounter group sessions. All evening sessions are conducted at 
the university in the group dynamics room where they are videotaped for 
the purposes of research, feedback to student co--trainers , and viewing 
by group members. The weekend sessions are held away from school in cabins 
which are rented at reasonable rates in nearby state parks. 
Cognitive learning 

In contrast with many other laboratory training program.s which place 



an almost exclusive empb;/> -.s on experiencing, feeling, and sensing, 
this program strongly emphasizes the cognitive, as well as the experientia 
aspect of learning. One of the most important determinants of learning 
outcome (Lieberman, 1972), the cognitive factor enables the studr;nt to 
know and to understand what he has erper r .;^:..d. By developing the 
ability to relate psycholoj2ical kr.owledge to Ais experience and state 
behavioral principles, he cau learn faster, retain longer,, and later 
transfer these princi^Aes more effectively to everyday life situations. 
To attain chese goals, we have designed the cognitive factor into the 
course in the following ways. 
Reading materials 

The course uses Egan's (1970) book E'acounter : Group Pro cesses for 
Interpersonal Growth , Stein's (1972) Eff ecti ve Personality: A Humani stic 
Approach , and the Lab orat ory Training and Personal Gro wth >Lan ual written 
by the professor. These present information which is directly related 
to the participant's experience in the groups on a wide variety of topics 
such as self-disclosure, feedback, confrontation, the learning process, 
and group development. Chapters are assifrned whenever possible so that 
the information is immediately relevant to the students. For example, 
chapters on the goals of laboratory training groups are assigned at the 
beginning of the quarter and a chapter on transfer is read just after the 
first weekend session when the first transfer problems arise. 
Iixl^ tur es and _dj . scuss i o ns 

In addition to the encounter group sessions the class meets twice 
a week for lectures and discussions. The primary Durnose of this 



arrangement is to supplement the readino; materials by presenting 
infomation which is not covered in the hoolts. A number of these 
classes are devoted to task group discussions of group development and 
the transfer process, two important arer.s of the course. 
Wr itten assignments ' 

To facilitate the student's understanding and further thinking 
about his experience, we ask him to write a "reaction paper'* after every 
session. This consists of a structured questionnaire which focuses on 
the most important aspects of the learning experience. He is asked: 
(1) to describe the group events of the evening; '^2) to give an account 
of his own participation in the group; (3) to state clearly and succinctly 
what he learned; (4) to indicate the most significant events of the 
session and their meaning to him; (5) to discviss any problems he is having 

(6) to state his own goals for the comino; sessions, weeks, or months; 

(7) to describe his plan of action for attaining tliose goals; and (8) 
to indicate how he will transfer his learnings to everyday life. 

"Application assignments" are specifically designed to give the 
student a task in which he has tc relate psychological knowledge and 
information directly to the group or himself. Done either individually 
or in a task group, these assignments focus on the topics of societal 
problems, group development, individual devclcpnent in zhe group, the 
real self, and transfer. For example, on the vitally important transfer 
issue, students are asked to discuss the transfer process, different 
transfer situations, and the difficulties associated with it, and then to 
make suggestions for facilitating' transfer. These they share with the 
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rest of the class in seminar presentations. 

At the end of the quarter, eadi student is asked to write a twenty- 
five to thirty-fi%re page "personal-growth paper' in which he gives a 
detailed account of the evolution of his personal growth throughout the 
course. In essence, this assignment is a longer version of the 
indxvidual reaction papers and covers the areas listed above. 
Group de velopra ent 

The group development process can be divided into two stages. In 
the initial stage, vjhich lasts about the first half of the quarter, the 
encounter group methodology is used to work towards the goals of group 
development and interpersonal ;;rowth. During this period learnings center 
mostly on the individual-within-thc-group and group process. The 'second 
stage begins when the group has developed to the point where it functions 
effectively as a personal growth group, that is, a group whose major 
task is to facilitate the personal growth of its members. At this time, 
the interpersonal orientation is replaced by an emphasis on the individual 
and his intrapersonal growth. Since the groups develop in a manner quite 
similar to the account, given by Rogers (1967) , it seems unnecessary to 
present a description here. 
Assessment o f person al growth 

The problem of what, when and how to m^^asurv'^ outcome is an extremely 
difficult one in the area of laboratory training as it is in education and 
therapy (Lieberman et al . , 1972). To begin with, the encounter group 
methodology and process are incredibly comple:-; duo, to the wide range of 
potential goals, the intricate web of countless interactions, and the 
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subjective nature of the experience. Secondly, good standardized 
measures of personal growth have not been de\;'eioped yet, and pre-existing 
measures such as personality tests are not appropriate to the measurement 
task. Thirdly, the phenomenal nature of reports from participants, 
members of their social networks, and even group leaders invites criticism 
on several counts. However, in spite of these problems and others, this 
challenging task must be confronted. 

To assess personal growth at the end of the course, we utilize 
information obtained through written assigrtments , observations, discussions, 
interviews, and questionnaires. The self-report is a very important 
source of information about the student and, thernforn , is weighted 
quite heavily in the evaluation process. However, since questions about 
the validity jf self-repcrts can be raised, the information from them is 
checked rather carefully against information provided by the leaders, 
non-participant observers, and other f;roup members in an effort to 
Increase accuracy. 

The student's final grade for the course is based on two equally- 
weighted parts: cognitive learning, as represented by scores on the 
various written assignments, and exrjeriential learnin,q, , as represented 
by personal growth derived from participation in the encounter qrouos. 
For the cognitive learning grade each reaction pnper is given a weight 
of two, each application assignment is given a vjeight of three, and the 
personal-grov;th paper is given a weight of twenty. After the lowest 
reaction paper score is dropped, ^he remaining scores are averaged. 

The experiential learning grade is based on th.e total amount of 
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personal growth which a student displays during the quarter. Here we 
employ an extremely flexible definition of personal growth. This growth 
can be in any area of psychological development. It can be derived from 
any of a wide variety of sources beyond mere participation in the 
encounter group sessions (from interaction with one particular person 
in the class, from interaction with someone outside of the class, or from 
working alone). It can occur at any time during the quarter and in any 
place. The only requirement is that the student presr^nt to the 
professor, in one way or another, the information about ais personal 
growth. 

The information gather:.d from these different sources is then 
compared to the growth of other students inthe course, the growth of 
students who participated in previous groups, and the professor's 
subjective estimation of the amount of growth possible given the nature 
of the experience as it evolved during the quarter and knowledge of 
the specific individual. After eH of this is considered carefully, the 
final experiential learning grade is assigned. In an evaluation session 
held at the end of the course, all of the collected information and the 
grades are presented to the entire group for comment and discussion. 
Students' per son a 1 g r o} Jt h 

Examination of information gathered from the many sources considered 
above suggests that most of the J^tudents profitted markedly by taking the 
course. Several fairly typical <^.xamples of students' personal grow*-h are 
presented below in the form of excerpts from their personal growth 
papers . 
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My participation in Psychology 467 has been the catalyst of the 

most significant and valuable experiences of my life the development of 

ray identity as an individual and as a woman. I am learning to be what 
I am and not what I think others want me to be, 

\Tho am I? I am a beautiful, unique woman cognizant of many new 

dimensions of her "real self^' positive as well as negative points, 

strengths as well as weaknesses, with real beliefs as well as direction. 
I am beginning tr- realize my potential and how to effectively channel 
it, I am learning to be "'me" and accept responsibility for myself. I 
never really experienced "me' before because I felt I wasn't as worth- 
while as I wanted to be. To avoid facing myself and risking rejection 
I managed to develop superficial relationships with myself and others 
via my defenses. The environment of trust and security provided by the 
encounter group experience gave me tlie jolt I needed to break do\m the 
defenses that were blocking my j^rov/th. I have developed more honesty 
and have confidence in myself. The inner security and warmth I have 
from Self-acceptance ha.s made me avare of what other people can give 
to me, -nnd more inr:>rtantly what I have to give others. 

This positive support will enable mo to continue to grow because 
my energy cones from witliin nyself . Beinp; intrinsically motivated is 
important because I have a lonjz way to go to achieve my goals. 

Through the experiences of t:he last three months I have become much 
more firmly established in mysel::. The beginnings of thinj^s such as 
confidence, self-love, self-accGptance , honesty,, emotionality, sensitivity, 
empathy, and peace fulness which came into bein?; this quarter have taken 
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shape aiid form, solidifying into the congruent unity of my real self. I 
have come to feel strong and confident in my knowledge of myself, both 
positive and negative, and in my ability to express my feelings, needs, 
and values. I have found that I can look at myself objectively, seeing 
my faults and defenses and still accept and love myself. In doing this, 
I can give much more of myself to others. Also, as I have become more 
aware of myself, I have more fully realized ways in v/hich 1 want and 
need to be interdependent with others wliile, at t]\e same time, I am 
beginning to feel mere free and independent, complete and whole in myself. 

The levels of my sensory and emotional awareness have increased 
considerably • I am more sensitive to myself, to others, and to the world. 
I can now more fully appreciate nature and all the simple pleasures of 
my senses that I seldom noticed previously. This nakes life invigorating 
and more exciting. Through my sensitivity to others, whole new channels 
of coraniunication have been opened up to me. 

I sefi my development in essentially three stages. Stage I was 
self-acceptance, acceptance of the group and appreciation of the fact 
that the members truly were concerned about my growth. Stage II 
involved going into myself and rediscovering who I am without my facades 
and defenses. Stage III followed, during which I have taken the insic^hts 
Continually provided by my Stage II activities and by interaction with 
the group and have transferred them to the outside world in terms of 
new behaviors. This is where thn strength of the course lies for me. 

My next step in personal growth was accepting p.* a pie as individuals 
and understanding problems as they related to them rather than iutemalizing 
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everything in terms of me. I found that I was being terifically shallow 
in all my relationships because I never really triea to understand or 
to reach out to others on their own terms, I V7as so into myself and 
my problems that I wasn't as sensitives, supportive or understanding as 
I believed I was, I realized that, fearing rejection, I had acted in a 
manner that brought about rejection. T began to really listen to others 
in the group and perceive what each member r>aid as it related to him, 

I am coming to have a great deal more trust in ny o\m values and 
feelings, greater awareness of my psycholoj.ical strength and independence, 
greater self-esteem and confidence, and deeper understanding of myself, 
my needs and motivations. In general, I foci more accurately ax^raro of 

reality the external reality of situations and relationships and the 

internal reality of myself. 
Course evaluat i ons 

In order to evaluate the course and obtain information which might 
be helpful in inprovinrr its design, V70 ask that students ansv7er anony-- 
mously a questionnaire at the end of each quarter. The first part of 
the questionnaire is composed of twenty-eight rating scales which focus 
on specific aspects of the course. The second part is a leader evaluation 
form which students complete for the trainer and the student co-trainers. 
Also, as a part of their porf^onsl growth papers, we ask the students 
to write out a summary of the entire course and wliat it means to then. 

To give the reader information about student response, we briefly 
present here the results obtained from the students who enrolled in the 
course the first time it was offered. Students found the course extremelv 
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relevant and indicated that it penetrated deeply into themselves.. They 
rated as extremely important both the course and the learning obtained 
from it. Personal involvement v;as hi^^h with most students spending a 
large percentage of their total academic time during the quarter on 
this course. In the words of one student, 'The course was demanding. 
Anywhi.rc Irom 65% to 15% of my time these last few months was spent 
in various class activities or related thought. However, v;hen I 
consider the payoff, the significance to my life, this was little time 
and v^ffort to spend for so much profit.'' 

,^ot oily did they indicate that they were highly motivated to j^rox^; 
personally, but, in fact, they did grow a great deal from both the 
experiential and the cognitive parts of the course. Most felt that they 
had developed a personal-^^rowth orientation of considerable strength. 
The majority reported tliat the course significantly increased their 
enthusiasm towards mny different aspects of their lives. Furthermore, 
they were highly motivated to transfer their learnings to everyday life. 

The response to the cognitive part of Lhe course was also quite 
positive. Students reported that they Ip.arncd a []reat deal cognitively 
and that this very much increased the value of the encounter group 
experience. Moreover, they felt that the cour£;e stiniilated their 
thinking in many different respects. In spite of the fact that there 
were no exams, they stated that they learned the co^niti\^e materials 
better than in other courses and ^•^f^f^/^c.-r r^r^ that the policy of no 
examinations be continued. 

In summary, then the students' overall evaluation of the course was 
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highly positive. They gave it a ''grade'' of 94, considered it to be 
better than 84% of their other courses, and stated that they would 
recoTTiinend it to other students. Surprisingly few criticisns and 
suggestions for improvement were offered. Perhaps, the common positive 
response to the course can be captured in the. words of" one student who 
wrote, "If I were to think of life as a journey > then surely this course 
was the first real step of that journey for me. In every way it was 
the most worthwhile and the most meaningful period of my life, and 
hopefully, it will become more important as time goes on, I have never 
learned so much in such a short time, and never before has learning 
been of such great importance as the learninr; that took place in this 
course. *' 
Appl i cations 

Training programs, laboratory training techniques, and coutr-es 
such as the one we have just described have a wide range of applications 
throughout our educational systeni and especiaJ ly in our universities. 
On the college level, schools such as the new University of Redlands 
have utilized group techniques to facilitate the development of the college 
community and as an integral part of the college design (Greening, 1971). 
On the departmental level, Boston Collei^e, as one example, made 
considerable use of the T-group in the evolution of a new graduate program 
in community social psychology; other departments employ group techniques 
in the interest of more effective intra-departmental communication. 
University counseling centers and psychological clinics offer various kinds 
of groups to the i^^tudent body (Morris et al,, 1970). Organizations such 



-157- 



as student governments , fraternities, and sororities, and human relations 
groups, to name just a few, take advantage of the methodology to improve 
their particular organization. Some departments require their majors 
to enroll in certain courses or participate in certain training programs. 
Finally, there are courses in most universities to which students flock 
by the dozens. 

Beyond these applications there are several others which we might 
explore here briefly. Training programs might be offered as a part of 
a large number of courses (social psychology, personality, humanistic 
psychology, etc) to work towards certain objectives which are more 
effectively reached through the experiential learning process than by 
cognitive learning alone or to facilitate students' learning and application 
of the cognitive content of the course (B.iles, 1970). For example, we 
have offered Growth labs, a shorter laboratory training program ranging 
from sixteen to fifty hours in groups, as one of many grade options 
in six different psychology courses over the last four years. Student 
response to these groups. is almost always enthusiastic and many feel that 
they are the most important part of the course. 

Application of these techniques, however, is not restricted to 
use in psychology courses; they can be used as an educational tool in 
just about any class. As an introduction to a course, the group experience 
enables students to get acquainted with each other and the professor 
and to become psychologically involved. Perhaps even more important, 
it helps to establish a more ideal learning atmosphere in the classroom 
community. Task groups develop more rapidly and function more productively 
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if attention is paid to process concerns through the use of various 
group techniques. In particular, certain structured exercises work 
especially well in this restricted context. 

V/e have also found that discussion groups can be facilitated so 
that they take on certain encounter group characteristics. After several 
ueetings the students begia to interact nore personally within the 
group and self-disclose at deeper levels. Gradually, they become more 
open to self-examination and more receptive to feedback from the group. 
The content of the discussion group then becomes much more meaningful 
and relevant as tlie individual applies it to himself. In addition, nost 
students seem to enjoy the feeli.ng of belonging to the coliesive group 
which develops. 

Beyond these applications, we believe that courses such as this one 
and other related courses (Interpersonal delations, r.roup Dynamics, etc.) 
should become a standard part of the college curriculum. !s^ith their 
emphasis on personal-social-enotional development they provide the 
badly needed opportunity for individuals to come to know themselves 
better, to develop psychologically, and to develop a host of communication 
skills. In doing so, they fill the void v;hich currently exists in this 
area of a student's education and thus mal-e more likely the education of 
the "whole" human being. 
Final comment 

This description of third force education and the small sample we 
have provided are optimistic to be sure. V^e should i*>ot lose track of 
the criticisms whicli this field Tiust confront and answer as it develops, 



-159- 



but We cannot help being hopeful about the contributions it can make to 
our troubled society. As Greening (1971, p. 102) writes, 'Still, if we 
are to reverse the endless saga of man^s inhumanity to man > I believe 
that few social inventions can equal encounter groups as a method for 
enabling people to learn from their differences and discover or create 
their unity. Ulien future books on existential and humanistic psychology 
are written > I predict such groups vjill be seen even more clearly as a 
major way in which man makes his ov7n human nature, ^ 

The picture can be a happy one, * 



-160- 



Alschuler, A., "Psychological Hduc? t ion" , Jour nal of Hu nanistlc Psvcholoqv, 
Vol. 9, (1), 1969, pp. 1-16. " * ~ ^ 

Bales., R. F., Personality and Interpersonal Behavior . New York: Holt, 
Reinhart and Winston, 1970. 

Buhler, C. and Allen, M. , ^nt_rodj.yj t l^n^ r^ychology . Belmont, 

California, Brooks-Cole, 1972, 

Clark, D. H, , "Encounter in Education", in L. Blank, G, B. Gottsegen, and 
M. G. Gottsegen (eds.), Confrontat i on: [en counters in Self and Interpors ona 1 
Awareness . New York: MacMillan, 1971. 

Egan, G., Encounter: Group Pr oces^^ es f or Interpersonal Growth . Belmont, 
California: Brooks-Cole, 1970. 

Goble, F., The Third Force . New York: Pocket Books. 1971. 

Goodman, P., Coinpulsory Mis -education and the Com munity of Schol ars. 
New York: Random House, 1966. ' 

Greening, T. C, "Encounter Groups ^rom the Perspective of Existential 
Humanism", in T. C. Greening (ed.). Existential Humanistic Psyc h ology. 
Belmont, California: Brooks-Cole, 1971. 

Lakin, M. , Interpersonal Encounter: Theory and Pra c tice in Sensitivity 
Training . New York: McGrav7-Hill , 1972. 

Leonard, G. B. , Education and Ecstasy . New York: The Delacorte Press, 
1968. 

Lieberman, M. A., "Behavior and Impact of Leaders"« in L. N. Solomon and 
B. Berzon (Eds.O> Mew Perspectives in E nc ounter Groups . San Francisco" 
Jossey-Bass, 1972 . 

Lieberman, M. A., Yalom, 1. D. and Miles, M., "TnipacL on Participants", in 
L . N . Sol omo n and B, Berzon (eds.), Ncv/ Per spec ti vcs in Encounter Groups . 
San Francisco: Jossey-Bass, 1972. 

Ma slow. A., To ward a Psycholo gy of Brin^. Nev; York: D. Van Nostrand- 

Reinhold, 1968a. 

Maslow, A., Music Education and Peak-Experiences. Music Educators Journal . 
1968b. 

Maslow, A., Motivation and Pe rso nalit y. New York: Harper & Row, 1970. 

Maslow, A., The Farther Reaches of Human Nature. Nev/ York: Viking Press, 
1971. 



-161- 



Morris, S. B., Pflugrath, J. C. and Taylor, B., "Encounter in Higher 
Education", in A. Burton (ed.), Encounter. San Francisco: Jossey-Bass, 
1970. 

Peterman, D. J., "Toward Interpersonal Fulfillment: in an Eupsychian 
Culture", Journal of Humanti s tic Psychology , Vol. 12, (1) 1972, pp. 72-85. 

Reddy, B., "Screening and Selection of Participaots", in L. N. Solomon 
and B . Berzon ( eds . ) , New Perspecti ves in Encount er Groups . San Francisco : 
Jossey-Bass, 1972. 

Rogers, C. R. , "The Process of the Basic Encounter Group", in J. F. T. Bugental 
(Ed.), Challenges of /Human is tic Psychology . New York: McGraw-Hill, 1967. 

Rogers, C. , Freedom to Learn . Columbus, Ohio: Charles E. Merrill, 1969. 

Rogers, C. R., On Encounter Group.q . New York: Harper & Row, 1970. 

Shaevitz, M. H. and Barr, D. J., "Encounter Groups in a Small College", in 
L. N. Solomon and B. Berzon (eds.). New Perspectives in Encounter Groaps . 
San Francisco: Jossey-Bass, 1972. 

Shepard, H. A., "PersonaJ Growth Labs: Toward an Alternative Culture", 
Journal of Applied Behavioral Sciences , Vol. 6, (3) 1970, pp. 259-266. 

Silberman, C. E. , C risis in the Classroom: The Remaking of American Education . 
New York: Random House, 1970. 

Taylor, H. , Studentt^ Without Teachers: The Crisis in the University . New 
York: McGraw-Hill, 1969. 

Thomas, H. F., "Self-actualization Through the Group Experience", Journal 
of Humanistic Psychology , Vol. 4, (I), 1964, pp. 27-38. 

Yalom, I. D. and Lieberman, M. A., "A Study of Encounter-Group Casualties", 
Arch. Gen. Psychiat. , Vol. 25, 1971, pp. 16-30. 



-162- 



THE "ADVERSAKY METHOD OF TEACHING 
Howard L. Oleck- 

For twenty-five years I have used a method of teaching in law and 
other classes, which is my own "invention" and which I call "The Adversary 
Method". \^ile this method was int;ended originally only for classes in 
law schools, I have used it with most satisfactory results in teachin[^ 
other subjects (history, literature > military science and tactics) and 
other categories of students as well (such as undergraduate classes, and 
in continuing (adult) education courses). 

The effectiveness of this method has won almost unanimous acclaim, 
by students, who often describe it both informally and in formal evaluation 
surveys as the best and most interesting m.ethc^d they have ever seen. The 
method (probably as much as my ovna quality a teacher) has won regular, 
year after year, evaluation by students and faculty and inspecting 
educators as a teaching technique second to none. This may sound immodest, 
but it is sim,ple fact; no brag. I need only refer yon to the records. 

Parenthetically, I add that few great teachers have been demurely 
modest persons, while many poor ones have cloaked their inadequacies in 
the mantle of meek modesty. In fact there are few good teachers who are 
not also born ham actors like me. Indeed, the best teachers almost alvjays 
are blazing "personalities", whose charisma, wit, charm and "bite" make 
their scholarship and ability seem far greater than thoy actually may be. 



'^Distinguished Professor of Law, Cleveland State University 
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Method really is a secondary inatter to the hest (bom) teachers • But 
effective method can greatly assist even a born teacher; while it may save 
even an untalented plodde^r from failure. 

Emulation of my method has been surpirlsingly rare, despite the fact 
that so many people have seen and praised it. My belief is that most people, 
quite erroneously, think that it is my scintillating personal teaching 
ability that makes the method work so well — which, of course, means 
that most others (even fine teachers) avoid the method lest they look 
i^7eak by comparison. In fact, quite a number of professors have told me 
just that. But the irony is that the method j^er se goes very far tovjards 
making success for tbosc bold enous:^h to try it. 

Among the professors who now do use the metliod at least occasionally^ 
are such top flight law professors as James K. Weeks of Syracuse 
University, Marcus Schoenfeld of Villanova University, James E. Brown of 
University of Missouri at Kansas City, Justin C. Smith of University of 
California, Hastings, and others. At Cleveland State University College 
of Law some professors very occasionally do use the method, but none (as 
far as I know) has truly adopt^ed it as his or her m.ain method. 

Twice now I have written up the Adversary Method (1, 2). I have 
lectured on the subject at the invitation of faculty and students at Case 
VJestern Reserve University (about \9Cy?.) and other law schools, and to the 
League of Ohio Law Schools (about 1959). All in vain. Few teachers have 
had the courage and self-confidence to take advantage of the great 
advance in educational methodology which is the Adversary Method. 
How the Method Works 
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Seriously, the Adversary Method is a natural expression of the case 
method of law teaching. In the bargain, it employs a number of other 
educational devices. Its chief drawback is that it demands from the 
instructor perhaps more work than any other method of law teaching. That 
small defect, I suspect, may be fatal to its wide adoption. It seeks to 
follow the normal practices of the case-hardened lawyer. 

The instructor calls student Smith to be counsel for the plaintiff 
in the case, and student Jones to be counsel for the defendant. Both 
counsel stand, facing the class, with whatever notes and books they wish 
to use. They are to be advocates In the true sense of the term. By 
their contest, they are to winnow out the truth of a case. 

The instructor then states the facts of the case. It is the 
instructor's task to reduce the complex story of a case report to terse 
essentials. All facts are simplified and stated in the present tense. 
In is assumed that the facts are familiar to the. students, l: ut even if 
the students have not read the case, they quic^-.ly can ^rasp trie situation. 

The first question is then put: What does Smith's party want? 
Then, what is Jones' laan after? These are factual questions based on 
probable motives and normal humc.n desires. 

Next, the plaintiff must decide what kind of legal action he will 
bring, and for what kind of relief. The defendant's legal objectives also 
must be indicated. Thoy must select the legal tools to achieve the 
objectives desired by their clir-nts, as lawyers must do. 

Now, the plaintiff must state his theory of action and outline his 
petition, succinctly, and in siirple though formal terms. A certain 
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minimum knowledge of practice and pleading suffices as the framework 
within vjhich to couch the complaint. Complex procedural issues are 
avoided . 

The defendant answers, by demurrer (stating the ground*^ t^^erefor) , 
by confession and avoidance (statinjj: his grounds) , or occasionally hv 
denial (which merely postpones his duty to employ law rather than facts 
as his defensive argument) . 

As each step progresses , the instructor guides and clarifies the 
students' statements and presentations. Of ter , the student's statements 
are rephrased in order to make them more readily understandable and to 
improve their form. 

Digressions, such as motions to make more definite ^.nd certain, or 
brief examinations before trial, r.-^irely am necessary or desirable. The 
quality of the casebook employed obviates tlie need for much such 
explanatory maneuvering. Iluch depends on the simplification of facts 
done by the instructor. In spite of all these seeming procedural problems, 
there is, in fact, hardly any trouble with practice or procedure, even 
in first -year courses. The students' knovleHge gained in an Introduction 
to Lav Course seems to be adequate for the purposes of the adversary 
method. Only in the first three or four sessions need these procedural 
matters be carefully explained and corrected. Rudiments of procedure 
suffice. Yet, the inevitable need to xnLerrelate substantive and 
adjective lav? becomes quickly apparent. ^-ery soon, the students In?- n. tc 
use the simple procedural forms for stating their arguments. They 
quickly become accustomed to thinking in terms of both suits tan tive anr^ 
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and procedural aspects of a C3se. 

Both sides having stated their casrjs in general terms, we then inove 
to specific arguments. Thus, in a nef^lif;ence case, the plaintiff cites 
the elements of negligence and then shows hox^7 his facts provide i:he 
elements, one by one. The defense then attacks the defective or missing 
elei^ients, just as specifically. Or the defense indicates affirmative 
defenses. Issue is joined, ArguntMits are developed, with stron;^ emphasis 
on syllogistic reasoning and presentation. Intuifiive and emotional 
reasoning are sharply discouraged. 

The two "attorneys" are allowed to expand upon their chief points 
for a few minutes. Then, the instructor renders the decision, summing 
up the pertinent reasoning and Ir^j. Throurhout the process, the other 
students are encouraged to interject questionr; and perf.inent comments. 
The entire class participates in each case» 

Finally, both "counsel" are requested to express their personal 
opinions as to the validity of the decision, the principles and law 
applied, Ghe possible dissenting opinions, ^^.nd the legal philosophy 
that underlies this and other such cases. Others who wish to coirrment or 
ask questions are also free to do so„ ^vhen all goes well, as it usually 
does, the discussion grov/s v/arm and must finally be cut off by the 
instructor in order to t.?J:a another caso. 
"^1^ ltist:ructor \s View o^f the 'J^thod 

In preparing to use the adversary motiiocU the chief task of the 
instructor is to br:ef the cases in terms of "P" for pl^iiptiff and "D" 
for defendant. Complex fact situations in the renorts must be boiled 
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down to a simple series of statements of what happened. Written briefs 
are almost indispensable to the instructor, for each case. 

Sf.udy assignments include text material to be read first, then the 
cases and also commentary-type material such as ^i^sj:_at_ement^^ Jaw review 
notes, and the like. The student must have a fair general idea of the law 
involved if he is to analyze the case well. In a sense, the cases often 
are illus:rative material rather than raw materials Yet, by reversing; 
the assij>nment method occasionally (e., 5^,., assignin^j cases only), the 
student is trained to extract the lav; from the cases. Both approaches 
are used, not merely one of them. The modern "cases and materials" case- 
books lend themselves beautifully to this met'nod-which , after all, is 
the case method carried to its logic-il conclusion. 

At the beginning of the sem.estcr, the instructor explains the 
method to the class. It is pointed out thai: tliis is a fine opportunity 
for. each student to act like a lavjyer at every session, or to make a 
blithering ass of himself* The chance to think, on his feet appeals to 
alir.ost every student, as docs the chance to approximate the actual 
function of a lawer in practice. All th::s makes for an interested class, 
with everyone participating; at every session. Very often, in this m.ethod, 
the instructor feels that electric snnsc of communication that is the 
chief reward of a teacher \s lit'e. 

Time after time^ in everv class without exception, I have been told 
by many students that tlicy en^oy the adversary method. Verv often, students 
have said, "This is the best method of instruction that I have ever seen.'' 
I repeat this with no sense of f i.Ise modesty, vrhat nlie student thinks 
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of the instructors and of the methods of instruction seem to me to be 
vitally important. I do not hold with those instructors who say that 
the student does not know what is good for }iim. 

This method enables the instructor to cover four to six cases, or 
more, quite thoroughly in an ave7:a^e two-hour session. By starting the 
session with a short summary lect? ire on the law to be treated before 
taki;*g the cases, the cases are made easier. Sometimes the order is 
reversed; the cases are taken first, and then the session is ended with 
a short lecture-summary of the law. 

Occasionally, the procedure is varied. A student is called on to 
state the facts, and then discussion is conducted in the method usual in 
most law school classes. This prevents students from coasting on the 
instructor's work. Yet, the adversary method itself quickly reveals 
the student \:ho is unprepared. Natural intelligence and general knowledge 
may enable a student to perform weakly when unprepared, but not to 
perform well. 

Socratic questioning by th^^. instructor is applied often, hut not 
invariably. From the instructor's viewjioint, the adversary method is 
eminently flexible and endlessly challenging to him as well as the students. 
Subj^ects in \^ic h the JletJiod_i s_ Us ed 

I began to experiment with tlie adversary method in 19->/, owinc; to 
dissatisfaction with the dullness of student presentations of cases. 
Student interest was manifested at once- Since 19A8, and in both day and 
evening law school classes, T. have employed this m.o.thod regularly with 
consistently satisfying result5;. The subjects in which it has been used 
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range across the entire curriculum. Specifically, the. subjects have 
included Torts, Corporations, Non-Profit Organizations, Creditors' Rights, 
Equity, Real Property, Bankruptcy, Corporate Reorganization, f^usiness 
Organizations, Bailments, and Carriers, and Suretyship. I h.Ave used the 
adversary method at New York Law School and at Cleveland-!tarshall Law 
School • 

Originally, it had seemed to me that perhaps the method mip;ht have 
to be limited to naturalistic, equity-type courses, but now I am convinced 
that it can be used v:ith profit in almost every course in the law schools. 
It is as interesting and provocative in a formal statutory course sach 
as Bankruptcy or Corporations as in a common-law course such as Torts 
or Real Property , or in Equity. It lends itself as well to purely 
adjective subjects as to substantive law subjects. In brief, there seems 
to be no course in v7hich it cannot hv. used to good advantage. It seeris 
to impart interest to every course. 
Analog ous Methods 

The problem method, used at s^ome schools in the past few years, is 
somewhat analogous to the adversary method. The problem method, however, 
is based on written materials specially prepared for the purpose and is 
a much more formal techniqui^. Moreover, it seems to he limited in Its 
range of application, from the point of view of pedagogical utility. ^iy 
no means does this suggest any derogation of the problem method. It is 
excellent, but is not the same thing as the adversary method at all. 

Undoubtedly, there are others elsewhere who have used or are using 
methods analogous to the adversary m.ethod. But no one is using a method 
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closely similar in detail, as far as I have, been able to ascertain. 
Co nclusion 

This note is intended to report briefly the results of many years 
of use of the aaversary method in two law scliools, in day and evening 
classes, and nlso in summer sessions. The results have been uniformly 
good. \^at began as an experiment, grovjing out of dissatisfaction with 
the usual dry student presentations of cases, has crystalized into a 
time-tested technique that has proved eminently satisfactory. In the 
bargain, the method has invariably maintained the enthusiasm of the 
students and kept thct instructor keenly interested. 

It is my considered opinion that the advers.iry method is no less 
than the best method of lav school teach Inr^ th'it T over have used, seen, 
or heard about. It demands much of tho. instructor and of the students, 
alike, but its rewards are c-.reat. I coTmncnd It to the attention of l.iw 
teachers, again. For lv?.w teachers who v;ant t}\elr classes to have spirit, 
direction, a sense of exploration, excellent (and visible) results, the 
fire of contest that inspires the true advocate, and the timeliness of 
living philosophy, I know of no better method. 
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ACCELERATED LEARNBIG: AI^ E:<PEFB1ENT IK Ti-E APFLICATIC!^ OF SUGGESTOPSDIA 

NSarina Kurkov* 
I . Introduction 

(1) The Suggest opedic Method 

An experiment in teaching Beginning Russian vas carried out at The 
Cleveland State University in the Fall of 1971 ^"^ testing the applicability 
to an American curriculur. of Lozanov's suggest opedic teaching method in 
vhich suggestive hypermnesia is induced > in an ordinary state of wakeful- 
ness, in the ciassrooni (Lozanov, 1971). 

(2) Students 

The experimental section (Russian 121-2) consisted of fourteen stu- 
dents, with nineteen students in the control section (Russian 121-1), The 
arbitrary decision as to which section vould be experimental vas made before 
knowing anything about the enrollment. The nature of the experiment vas 
explained to both sections during the first session. The students were 
offered a choice — to stay, change sections or make other adjustments. 

In a community like Cleveland with ir.any ethnic groups, classes are 
composed of students who speak/hear languages other than English at horr.e , 
Some of these have studied the language at churcli school or at high school 
level. Those too advojiced foi^ the b^^f-:inninf^ level are placed in a higher 
level, determined by the MIA test 3 o.t the t:*:r:e of adrrission.. 

The students' records provided the following facts: in neither the 
experimental nor the control groups were there any students who spoke or 
heard Russian at home. However, i-'l^jA" of the experimental and 50/3 of the 

^Department of Modern Languages, Cle\ eland State University. 

"^Funds provided by the Research Initic.' iv:;- /rant av, r?leveland State Uni";ersity. 

ERLC 
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controi groups heard another Slavic language spoken at hcnie. Of the 
experimental group ^2.8/? had had some previous formal training in Russian, 
vhile in the control group the corresponding percentage was 2^ .U% . 

Exposure to another language at home or abroad (a Slavic language 
especially) and the formal study of Russian are significant factors in 
a student's progress, although difficult to measure and evaluate. Ml the 
students from hoth groups had studied another language (with varied amount 
of success for different lengths of time). Aptitude for languages was not 
tested . 

In order to determ.ine vrhether a basic difference existed between the 
control and experimental groups ^ the sam.e 60-iteiri test was administered 
to the two groups when each arrived at a given point in the test. Had 
their basic abilities or knowledge been significantly different the test 
results would have reflected this. The tests, however, showed no signi- 
ficant difference between the rej^alts of the two groups. V^hen two second- 
quarter Russian classes (taken from the mass-testing evaluation group of 
1971) vere tested at the end of twenty weeks, there was also, predictably, 
no significant difference between their levels of performance. 

( 3 ) Textbooks 

Both the control and the experimental groups used Clark's Russian for 
Americans (Harper and Row, 196?). The "book consists of twenty-eight lessons, 
preceded by four introductory lessens. Thece present the alphs'^^jt gradually, 
with the dialogues tra^nscribed phonetically. T}:e dialogues are recapitu- 
lated in Lessons l-^i in the Cyrillic alphabet, while the grammar secticns 
are expanded to include new material. The lessens contain grarjr.atical 
explanations, dialogues, exercises., readinK; material, exj-.re:35lcn lists 
(10-20 per lesson) and vocabulary lists of approximattfly fifty words per 
lesson. Language tapes and workbooks are availcLle. 
(U) Schedules and Goals 

The experimental class vj"as schedixLed to complete eighteen lessons 
in addition to the introductory A-D units in ten weeks (forty ^O-r^.inMte 
sessions). The control group was to keep the pace set by previous 
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Beginning Russian classe.v: nine lessons in addition to the intro- 
ductory series. 

Roughly stated, the goal of tht, experimental class was to cover 
twice ao much material as the control section in the same amount of 
time. An important concurrent goal of the experimental group was read- 
ing ability. An appraisal of the role of reading is given by Aronson 
(1970): 

In general, our first year courses emphasioe eitlaer conversa- 
tion or grammar (and usually achieve active command of gramjnar 
rather than passive). Reading , precisely because it is diffi- 
cult > is often postponed to the second year course. It is all 
too often forgotten that the pattern drills of our audio-lingual 
courses and the grammar exercises of m.ore traditional approaches 
are of no value unless they have generating power: i.e., they 
allow the student to generate (or decode) the greatest number 
and widest variety of utterances. , . . the real goal of the 
first' two years must be reading ability and all that that im- 
plies, namely passive rather than active comjnand of the gramjr:ar, 
more attention to the goal of passive comprehend- ion than to that 
of speaking, and the relegation of writing ability to a very low 
position in the scale of desiderata. 

Reading ability requires knowledge of vocabulary and the rudiments of 
gramimar. The experimental students/ knew enough gramr:?.r at the end of the 
ten weeks to handle syntactic unitr.', \:hile tlieir vocabulary corresponded 
to that of a student at the end of twenty weeks of ctudy. 

In addition to the vccabula-:^ics pnd express:.cno from, the text book, 
the experimental group wa-j givcri basic vocabulary lists (Josselson. 1953). 
A reasonable goal seemed to bo a t-^tal oi 695 vords. Many of these wo/ds 
overlapped with the textboc' vocabulavy and were considered basic to stude 
entering s econd year (fourth quarter) Russian. From Pushkin to Pasternak 
(Josselson and Parker, 1963), a widely T.;s.ed second year reader offers the 
following in the introduction: 
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... sampling of the vocabulary of the selections used in this 
reader, indicates that three-quarters of the words used belong 
to Lists I and II of The Russian Word Count . The remaining 
four lists account for about 15% of the vocabulary of the text, 
while about 10% of the words of the selections do not appear 
on the basic six lists. 

It follows that after ten weeks of studying Russian by suggestopedic 
means the student could master morn vocabulary than usual. This would 
enable him to read Russian v/ith a minimum of die ti onary^-thumbing frustra- 
tion. Reading, in its turn, is an effective vocabulary builder. 
(5) Tests and Standards 

A> The MLA-Cooperative Foreign Lang uage Test 

The MLA-Cooperative Foreign Language Test was developed to test the 
four basic language skills — listening, reading, speaking and writing. 
Two levels of the » est are used: The L level, aimod at the first and 
second year of secondary language and first year of college language, and 
the M level, for the 3rd and Ath year of high school and 2nd year of 
college level language. Each level is *'barely appropriate*^ for the other, 
being either too easy or too difficult. (For greater detail of the 
statistical characteristics of these tests one is referred to the MLA 
Cooperative Language Tes t s , Handbo ok and the Boo klet of Norn^s . 

B. Administered Tests 

Upon completing the sixth lesson in the textbook, (each group at a 
different time) the experimental end centre] groups were administered a 
test containing 60 units: 30 tested listening ability and 30 reading abil 
ity. The goal here was to determine whether t\\Gse two groups differed in 
their general ability to deal V7ith a given body of language material. 

The experimental and control g'-cur..o were tested at tho. MA--level of 
MLA of listening and reading test^ at the end of the tenth week of instruc 
tion. At this point the experimer ':a 1 group Y ad completed seventeen of the 
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proposed eighteen lessons, while the ccntrol group had finished the nine 
lessons as plann-jd. The purpos^e of the testing vas to determine whether 
there vas significant different between the scores of the two groups. 

Both classes were periodically tested on short quizzes which ultimately 
helped to determine the students^ grades. No com.parison was attem.pted at 
this level. 

C. MLA Series - The Rationale for Selection 

The MA level, appropriate to the second-year college level was used 
rather than the LA level., appropriate for the first year. The reason for 
this was the fact- that Cleveland State students placed higher on the ^:LA 
Russian language tests generally than the norms would le^^d one to expect. 
The need for such an adjust:nent had been foreseen by the developers of the 
series: "Interpreta.t- Ions based on the loca.l norms may differ significantly 
from those based on the national normf?." 

If 5 contrary to expectation, the experimental group did not produce 
scores high enough for comparison with the existing MLA scores administered 
to more advanced students, a relevant correlation between the scores of 
the ccntrol group and the experimentcl [;ro\:r- could still be m.ade. Had 
the LA level been used for testing the two rroups , there would be no 
possible upward com.parison with the h:ir:her r*,cores sinr^e for Russian the LA 
and MA scores are not convertible, and, as has been pointed cut above, 
it is desirable to draw com.parisons within local gr^^ps. 

D . Omission of Writing e.n ri. Speaking T^-sts 

There were several reasons for the .^--.ission of the written and oral 
tests. While speaking and writing skills v^ere not neglected in teaching 
the two groups, it seem.ed better to concentrate on the testing of listening 
and reading com.prehension, since the answers can be treated objectively. 
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Also, in -^rder to use earlier testing data from Cleveland State, we were 
limited tc? the above two tests. 
£. Other Uses 

It should be noted that the HIA scores were not used for evaluating 
students except to determine the validity of the experimental teaching 
ratthod. Hove-ser, in the light of the statement made by the Cleveland State 
Testing and Exraluating Committee, they could have been used. "Careful 
analysis of all the data suggests that the degree of correlation between 
MLA scores and class grades is very high, suggesting tl^nt, no matter what 
the sceptics think, the MLA tests do reflect adequately v/hat we teach." 
(6) Grades and Credit 

Both the experimental and the control group.s drev; one-quarter of 
their grade from the midterm examination, one-quarter from the final 
examination and one-half from the daily work — quizzes, written assign- 
ments, classroom recitation, laboratory progress, effort, attitude,, etc. 
The reason for placing greater value on daily work was to discourage 
cramming for both groups and to assure "copying'*' of the vocabularies for 
the experimental group. 

Members of the control group, upon successf-.O completion of the ten- 
week course, gained 4 hours of credit. Those in the experimencal group, 
having passed their midterm examination (which v;as equivalent to the control 
group's final examination), obtained credit and grades for ^.en V7eeks of 
Russian* The subsequent five weeks gave them an additional four hours of 
credit. The average grade for the control group was 2,5 (C) and for the 
experimental group (for the total of 8 hours) a 3-0 (B) . 
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II. Classroom Procedures 

(1) The Control Section: Russian 121-1 

With the control group the teaching method was eclectic. Before the 
students had mastered the alphabet, the emphasis was on aural-oral works 
on classroom repetition and the outside use of tapes. Exercises in the 
laboratory manual were periodically checked, although attendance was 
outside of classroom hou\"s and not mandatory. 

Grammar was assigned to be read but was explained in class only as 
the need arose. The hour vjas mostly devoted to exercises and drills, 
and later in the quarter, reading and elementary conversation. 

Both classes were aware of the existence of the other. From begin- 
ning to end the control group could be characterized as a typical 
Beginning Russian class. 

(2) The Experimental Sect io n: Russian 121-2 ■ 

The experiir.ental group met in a faculty confereuce room which con-- 
tained conference-type tables, padded chairs and a blackboard. There were, 
no outside windows and distraction was minimal since the conference room 
was surrounded by offices rather than classrooms* 

The students were told initially that in their experimental section 
a modified version of Lozanov's method v/ould be employed. It was called 
"accelerated learning" in order to avoid any undesirable connotations 
which "suggestopedia" might have. 

The class was informed that this method was successfully used in 
Bulgaria^ East Germany, Russia and India. The method, it was explained, 
did not involve hypno.^^is or sleep learning and was obviously not "total 
immersion". It entailed their relaxing while listening to a taped concert, 
during which the instructor would read language materials. They were to 
listen to the music, not the instructor. 
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In preparation for the passive, concert session chey would need 
to copy vocabulary lists from Russian to English and vice versa , 

The active part of the hour included reading, reciting dialogues, 
clarifying grammatical problems and taking quizzes, A modification of 
the method, justified by the brevity of the active session, lay in th e 
use oi* a native s:peaker in place of the tapes. The instructor and an 
assistant were available for one hour a week to practice pronunciation 
with the students. It was essentially the sam.e arrangem.ent that the 
control group had in the sense that attendance v;as not mandatory. An 
advantage lay in having pronunciation instantly corrected. 

This variable would be expected to have most influence on the pro- 
nunciation of students, and although students fron: both g::oui-5 made 
tapes in the course of their study, the laboratory" versus native-speaker 
element was not :itudied. 

No special training in relaxation was given to the students, other 
than the recommendation that deep, rhythmic breathing would facilitate 
relaxation. Some cradled their heads in their arms; others slid into 
semi-prone position in their chairs « Most kept their eyes closed during 
the passive session, during which lights were dimmed. 

Initially, the passive sessions were brief: tlie dialogue would be 
read from English to Russian and from Russian to English. Then relaxa- 
tion would be interrupted and students asked to repeat phrases after 
the instructor. Subsequently, as the students learned the alphabet and 
could prepare for the passive sessions by copying the vocabularies, the 
passive sessions were extended up to 30-35 minutes, with a 15-20 minute 
a^^tive session. Students expressed their preference for longer passive 
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sessions, noting that the relaxed state became deeper during a pro- 
longed passive session. 

The vocabulary quizzes, while consuming much of the active session, 
were given for each lesson. The majority of these quizzes were Russian 
word or phrase lists for which the student vould supply the English 
equivalent. V/hile the quizzes were graded in terms of percentage correct, 
this was nc'b a part of the daily grade. Diligence in copying was 
graded. 

Students could view their qiiizzes, but were not encourag.^ to do 
so. Instead, they were told their percentage and were each given a 
list of words which they sho'old rev±e\<r (words they had missed). 

The grammar section in each lesson was assigned as outsid-e reading. 
They were asked to check the appendix in order to see the segment of 
graminar being studied as a part of the total, scheme. Problems and 
questions were dealt with during the active session. 

The experimental group appeared to be less lively than the control 
group — perhaps due to the passive session, the more sedate surroundings, 
or the earlier hour. . (The experimental group met at 9=00 a.m. ; the 
control at 11:00 a.m.) The student-instructor rapport was not as well 
developed as with the control section, due possibly to the lesse.- 
active-contact time. 

III. Evaluation 

(l) Comparative Data 

Below, reference is made to four classes: the two Beginning Russian 
classes (the experimental and the control groups, Russian 121-2 and 
Russian 122-1, respectively) and fifth and sixth quarter Russian classes 
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(Russian 125 and Russian 201) , which were selected for comparison 
because they were of the same local groups as the above, and because 
the MLA test dana were already available. 

\ften the MLA examination scores for these four groups were processed 
by computer, it was sh'^wn that there was a significant difference 
between the scores of the experimental and control groups at the end 
of ten weeks of study. There was a significant difference between the 
achievements of the control group and the experimental group (at ten 
weeks) and fifth and sixth quarter Russian classes (at fiftieth and 
sixtieth we^ko), 

The results of the 60-item test, similarly processed showed no 
significant difference between the scores of the control and expe Imen- 
tal groups. This would seem to indicate that there was no basic dif- 
ference in the learning capabilities of the two groups. 

Students from the experimental p;roup having recex^^ed credit for 
Russian 121 and Russian 122 (8 hours) at the end of ten weeks, continued 
their study by merging with a class which had achieved its third quarter 
status by regular means. This merged 12'^ class, consisting of experi- 
mental and regular groups, proceeded to study Russian by intensive reading, 
supplementing this with language analysis exercicer^. written compositions 
and toward the end of the quarter, oral reports. The 123 program was 
somewhat ambitious in that a second-y^ar reader was used. More than half 
was covered, although one third of the ^ook is considered sufficient for 
a ten-week session, beginning with the 124 xeA/el. 

The suggestopedic method was not: practiced, al chough seme of the 
experimental group students inquired about continuing vocabulary study by 
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means of suggestopedic tapes. This was not done, although one student 
persisted in "copying" vocabularies. 

The overall grade comparison of the experimental and regular com- 
ponents of Russian 123 seem to point to an integration of the two 
groups, in as far as grades were concerned. Initially, there was social 
polarization between these two segments. Toward tne end of the course, 
however, the groups were well integrated. 
(2) Conclusion 

In evaluating the suggestopedic iTicthod , Lozanov (1971) writes: 
"The suggestopedic memorization session is decidedly a new element 
in the process of education. Its goal is to assure memorization of the 
program presented, which, due to the suggestopedic conditions, is signi- 
ficantly greater than the usual for the capability of human memory. 
With some experiments the material which is presented for me:T^orization 
may attain fantastic proportions." 

In this experimental application of sugges tology , the first ever 
at an American university, the results vjere favorable; the accomplishment 
of twenty weeks' work in ten weeks was considered encouraging, although 
one cannot with certainty isolate the responsible variables. The experi- 
mental students were shown to assimilate well into a group which had 
studied by regular means, Tnc grades of the experimental group in 
Russian 123 were satisfactory. In 3 2/< , vjhile no longer under direct 
observation, each experimental student was seen to perform according to 
his own interest and capacity. The early learning spurt during suggesto- 
pedic training, was followed by mor3 '■tr}r:nr'!d develjpment . 

It is to be hoped thaL lurther '-turies of suggestology in America 
would seek to broaden ^.eneral knowledge i;^ L:.is area lather than repeat 
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what has already "been '•■^ericnst rated in Bulgaria. Regarding application o 
the method, it should be stressed that for practical application, an 
internship is not only recoininended , but FGsential. 
(3) CoTnments 

It is interesting to consider some of the theoretical aspects of 
the suggestopedic method and to exa^nine the m ns and degree of their 
incorporation into the teaching experiment at Cleveland State University 
Authority 

Authority plays an important — if not decisive — role in obtaini 
good results with suggestopedia. According to Lozanov (1971), it 
is "one of the "basic elements in suggestopedic methodolog;^'-" . In a 
way, two other key elements '^infant ilization" and "intonation" 
depend on authority. 

Taking into consideration that the average American student 
does not stand in awe of his teacher as much (if at all) as his 
European counterpart- the effectiveness of suggestopedia might 
appear to be in doubt. However, there are many forms of authority 
which would seem to dispel tha-t doubt., Lozanov lists the 
authority of personality, dogma, faith, comjr.on sense (logic), 
experience, a good artisan, teac]:,or. doctor, ^-arent , the m.a.iority, 
the collective. 

The instructor's self-eval);.ation in terms of authority 
(medium minus to lov: plus) — based on the attitude of "let us learn" 
rather than "let me teach you" — was probably compensated for by 
the authority of the institution where the experim.ent was con- 
ducted; the authority of the instructor's belief in success of the 
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project; the authority of the majority (none of the original stu- 
dents switched to the control group when given the chance to do so). 
Equally important ajid quite apparent was the authority of experience 
which was demonstrated in the quiz scores. 

B. Infant ilization 

Lozanov's concept of inf antilization is not Freudian, as he 
points out, nor does it entail regression, being a selective 
process in which the malleable qualities of early childhood, such 
as trust, serenity and accepta,nce predominate. Norm.al intellectual 
activity is not impaired. 

\^en the means for achieving this are suggested, it is not 
difficult to see "infant ilizaticn" developing in the experimental 
class: ps eudopas s i vi ty (i.e, relaxation), a serene atmosphere 
generated by the dim lights, music; role playing (as in acting out 
dialogiaes); and the inevitable name change (even if the Russian 
equivalent is not given, an American name pronounced with a 
Russian accent is different.) 

C. Intonation 

The role of intonation in suggestopedia appears to be subsid- 
iary, a means for conveyin;'; o. strecj:i of signals to the studenc. 
Thus, a declarative tone", ''quiet tone, full cf significance", 
"a powerfiil, sure^ hard, final to:.e" — all are used to establish 
authority. And although Lozanov examines the part played by into- 
nation in great detail (including intonogreins ) he finally deemed 
it to be \innecessary . 
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D> Rhythm 

Experiments with rhythm have shown that with suggestopedia, 
a ten-second interval between utterances gives a statistically 
significant positive result. This rules out the contention that 
simple repetition is responsible for the result (with 1-second, 
and 5-second intervals it proved insignificant).. In the experi- 
mental class at Cleveland State, it was not possible to have 
the 10*-second pause, due to the brevity of the session. 

E. Concert Pseudopassivity 

Concert pseudopassivity is defined by Lozanov as the deep 
relaxation which occurs during the passive session. It is bene~ 
ficial but only insofar as it leads to a suggestible state. 
Calm and trust prevail, and no intellectual effort is made to 
recall or analyze. Thus,- the anti-suggestive barriers are over- 
come and various mechanisms discussed above are activated. 

Not having measured the degree and quality of relaxation 
experienced by students during the passive session by recording 
the bioelectric activity of the brain, t^r.^e is only the student' 
own assessment of the quality and degree of his rela:-:ation. Of 
the polled group, 41.5% ^'sometimes relaxed**, while 24.9% always 
relaxed, with an 8.3% concentrating on the instructor. 

F. General Remarks 

It would appear, judging from the student evaluation, that, 
on the whole, they were in favor of the method, although ir.any 
felt that they needed to spend more time than usual in outside 
preparation, such as vocabulary copying and reading grammar. 
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The assignments, from the instructor's point of view were the 
same length as other Beginning Russian assignments. 

Approximately one-half of the students thought that they 
could have accomplished as much without this method, while one- 
third thought they co\iLd not. More than one-half estimated that 
they could have done as well if no grades were involved, while 
the one-third assumed that it was better to have the incentive 
of grades. 

Over ore-half of the experimental group were satisfied 
with their accomplishments, Q.6% were dissatisfied, while the 
remainder had specific recomriendations instead — such as: '^W.:^ 
went too fast", ''Most relaxing class", "I sho\ild have' copied 
more consistently", "We shoiild have spent less time on easy 
lessons, more on the hard", "Longer passive sessions". 
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NECESSITY FOR DEFINING OBJECTIVES IN COURSE DESIG!? 
Jack A. Soules* 

You have all gathered here today to hear a discussion of educational 
objectives in course desigi;. I owe you an apology. At the time this 
talk was scheduled, that seemed like a proper topic for early March, In 
fact, however, this audience has enjoyed several presentations on that 
subject, all of which were better than anything I could hope to do. So, 
with the permission of your program chairman, I have prepared my remarks 
today on a related but somewhat different topic, I am going to depart 
from general principles and avoid offering a sermonette on good teaching. 
Instead, I am goint; to describe some small examples of clever teaching 
that have been successful for me. They are obviou^sly selected; out of 
the dozens of things I've tried — most of v/hich wp.rcn't very successful — 
I've chosen a handful that gave me a great deal of satisfaction and a 
strong feeling of success. Besides, my students liked these tricks and 
methods and responded favorably to them* which may be why I enjoyed them 
too. So let's change the title of this talk to; Examples of some ways 
to make ordinary teaching a. little better . 

In selecting my examples, I have chosen six problems which have 
always troubled me in my o\^m tes,ching: 

1. How to relate the classroom discussion firmly to the course 
objectives in a way that students can see the connection* 

2, How to examine a large class of students (about 150) on objective 
material without spercHng 3 months marking the papers, 

*Deaii, Arts and Sciences, Cleveland State 'University 
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3. How to base the final grade on the level of skill at the end of 
the course. That is, how to avoid averaging grades earned in the second 
week of the course with those earned on the final exam, 

4. How to give students an opportunity to do laboratory experiments 
for themselves at low cost and without cookbook recipes that destroy the 
whole spirit of experinentation. 

5. How to build students* skills at responding to essay exam 
questions. How to make the objectives of such questions clear to students, 

6. How to provide prompt feedback on exam questions so that exams 
result in learning as well as te.stin^^. 

The rest of these remarks will simply describe some tactical approaches 
to these six problems. 

Problem 1. How to relate the classroom discussion firmly to the course 
objectives in a way that students can see the connection. 

Ever since I began teaching physics I have prepared carefully what 

the class was to cover that day. Usually I carried a sheaf of notes to 

class to make sure that I omitted nothing, from remembering to announce 

the assignment to reiaembering the tricky ateps in a complicated derivation. 

In short, I strove for a c^ell-choreographed performance. Gradually, I 

was able to turn my students more and more to texts where they could read 

what I would othen>rise have said, thus leaving classtt'me free for students 

to talk and ask quesLions while I listened and answered. All well and 

good. My students stayed awake and were', clearly, learning. However, 

after ten days of this they were frequently unsure of what they had learned — 

and so was It CI ;Ssroom discussion tends to wander over the subject 
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like a butterfly in a daisy field. It needs tying together. 

I have used two devices. For one: two students, selected at random 
or sequentially, have been assigned to take class notes for the day. The 
notes are recorded in two spiral notebooks and signed by the authors. I 
then review the notes at the end of class in conference with the students 
correcting errors, filling in omissions and generally patching things up. 
Students are not good note takers and they need the tutoring for its own 
saker The notebooks are a valuable review and study tool for the whole 
class, particularly for those who are inevitably absent from time to 
time. 

My second device is to draw from ,the notes a set of "study 
questions'' which focus explicitly on the topics of the prececding day. 
The study questions are handed out at the start of each class, covering 
the topics of the previous class. They may he trivial or subtle, ranging 
from definitions, vocabulary, or simple problems to examples of 
examination questions. In my view the study questions ought to include 
at least two life-size exam questions each dc^y. By the end of a quarter 
the student will have in hand about 60 or 70 exam questions, a half-dozen 
of which will appear on his final e^ian. If the instructor is faithful 
and hard-working in providing study questions, he can promise that the 
final exam will be dra\m entirel^ ^ from study questions already presented. 
The student r>o longer has to guena hov; he will be tested. 
Problem 2. An easily graded objective exam. 

Physics tests are heavily weighted with definitions and numerical 
problems or exercises* Most physics instructors score these problems 
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carefully, giving part credit for a problem which is well begun but goes 
astray on a decimal poinc, a calculation error, etc. Such marking is 
tedious and almost impossible in large classes. 

In my work I attempted to restore some semblance of dignity to the 
multiple-choice test. After all, in spite of its flaws it is widely used 
in the GRE, various intelligence tests, license exams, etc. I turned to 
the computer for help — partly so that my students could use optical scan 
mark-sense answer sheets. First I enlarged th.' answer field from 5 
to 9 choices. The optical scan equipment will record as many as three 
marks per column so that students vers informed of that fact: Uo question 
requires more than three marks. Next I designed questions that required 
complex answers, for example, a and g is correct, a and g with c is half 
correct, h with anything is wrong, etc. There are 129 possible answers 
to such a question. Actually, it was necessary to consider no more than 
about 40 combinations for any given question. The rest of the 129 
possible responses were equivalent to one or another of these 40. I 
have some examples of questions with me. 

Problem 3. How to develop an achievement based final grade. 

\^en the computer is introduced into the teaching game, it provides 
other useful services as well as paper grading. For example, every 

student's score on every tast question is recorded. Since this data was 

*> 

available, I made the following policy: 

1. There will bti three hour exams of 40 questions each. 

2. The final exam will contain 80 questions. 

3. The final grade vrill be based on the final exam only; no 
averaging of grades. 



4. Of the 80 final exam questions, 60 questions will be dra\^ from 
the hour exams, twenty from each. The 20 most frequently missed 
questions will be selected. 

5. If you receive a score of x on a certain hour exam question, you 
will receive a score no less than x/2 on the final for that 
question. 

6. The actual questions may be disguised with different numbers, 
different word order, etc. but vjill be the same questions. 

The results were encouraging. Students studied material they were 

weak on. I believe the objectivity of the whole process helped sor.e 

students to improve their exam performance over what it would have been 

in the conventional form. Certainly the system was popular. It was 

praised by students as fair and not ^'tricky.*' Soma students were 

apprehensive about having so niuch of their course grade pivot on the 

final exam. After all, averaging grades lets the student take out 

"insurance" early in the course. I did lots of counseling with students 

who had scored 80-90% on the hour exams who realized they could still 

fail the course. They didn't fail, of course. 

Problem 4. How to provide economical, effective lab experiments. 

Most scientists agree that laboratory work, manipulating the real 
objects to see real effects, is the heart of science. Yet in practice, 
our laboratories are expomsive, cumbersome and ineffective agents for 
''behavioral change.^' For years I have been interested and iiiVolved with 
the search for solutions to the lab problcm^ One solution which has 
been effective (and fun for me) is whnt I call the "lap experiment." 
A lap experrl^ent is one whic]i can be performed by the student at his desk 
or at home with modest, perhaps nomebuilt equipment. To be effective, 
the "lap experiment" must actually reveal the physics. VJhen I began to 
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teach large classes ' f 100 or Tnore students, the need for such experl»nents 
became crucial^ I now have a handful of good ones, not enough for a 
whole course but from timG to time I get an inspiration for a new one. 
VShen 1 moved to CSU, for example, I was for the first time on a campus 
with high rise elevators. My most recent *'lap experiment" is to ride the 
elevator on a bathroom scale recording and analyzing the readings. Try 

it: 

For today, I have brought a picturv'? which is the heart of a "lap 
experiment" to illustrate the basic law of mechanics. It goes like this: 
I rig a camera and strobe light over an air table as a classroom 
demonstration. Two pucks are permitted to collide and the open-shutter 
camera records a series of dots as 'rhe strobe light blinks. The dots 
are formed by light reflected from a pin in the center of each puck. 
Polaroid film lets the class see the data at once. We take several 
pictures and generally "mess around" with the apparatus. At the end 
of the class hour each student receives one of the: prints (I have 
about a dozen) to take home and analyze; that is, he is to select 
coordinate axes and construct graphical re|3resent ations of the velocity 
and acceleration of each puck as a function of time. Since the axes 
are arbitrary there are an infinity of ways to perform the analysis. 
The physics just "pops out" as the accelerations are plotted. It^s lots 
of fun. 

Problem 5 . How to build students' skills on essay exams. 

In spite of my earlier remarks, not all of physics can be treated as 
a set of numerical, objective problems. Furthermore, if your students 



have strong verbal skills this should be built upon so that they can 
express their mastery of physics in their own terms • Therefore, in 
addition to multiple choice, computer graded exams, I also asked my 
students to respond to essay questions • How to apply the principles 
of behavioral conditioning to this method? Well, I decided that the 
biggest flaw in the essay question i« that it becomes a guessing game 
with the instructor. So, in addition to providing a list of possible 
questions to the students in advance > I also provided some answers. I 
am sorry to say I failed to provide answers in advance but I did poi^t: 
them on my bulletin board. Now I am well aware that one of tiv^ reanuais 
for the essay question is the general ambiguity of knowledge, that for 
many questions there isn't "one right answer," Fine. I posted tv/o or 
three (and I would put up 5 if I had had the patience) ercamples of good 
answers to my questions. Students who completed an exam could walk 
straight out the door of the exan room and read instant examples of A 
(and C-) answers to those questions. Ladies and gentlemen, that does 
worki It results in obvious behavioral change, particularly in C students 
with poor verbal skills. They quickly learn to do better. The benefits 
to morale are also evident. Poor students in particular believe that 
essay exams are a guessing game with the professor. \^ien examples of 
good and poor work are available, they dn generalize From the examples 
to luarn the art of th^. test. ^nd '.hG v?::a:nnles are effective precisely 
because poor students have been denien acccs" to r^,ood examples in Lr.e 
past. They never wrote any I or at least not Uiough to reveal a general 
style or quality. 
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UTiich brings me to my final problem: instant feedback of test 
results. It is a relatively easy matter to post the correct answers to 
a multiple choice exam on the wall outside the classroom. It is even 
better to provide an annotated list which illustrates how to work out the 
problems. It is also valuable and easy to post good answers to essay 
questions. The important thing is prompt feedback which means that feed- 
back in the form of correct answers must be available within minutes, 
even seconds after the response is mde. Parenthetically, we are putting 
together a whole classroom wired electronically so that some of these 
ideas can be tested. A series of pushbuttons on each tablet arm will 
permit real time quizzing and instantaneous correction of answers as well 
as, ultimately, computer recordings of the results. 

A colleague of mine deserves credit for my final innovation. A senior 
physicist with a brilliant, creative mind, he brought the ultimate in 
technology to the classroom. His students write all their essay exam 
questions using carbon paper . He keeps the original and they keep the 
carbon so that comparison of exam responses with one another and with his 
(posted) prototypes is possible. He reports observable improvement in 
writing skills and accuracy of ri3sponse to the questions. Besides, his 
students like it I 
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AN INDUCTIVE APPROACH TO LEARNING LITERATURE 
Susan Gorsky * 

How often, in response to the instructor's lecture or an outspoken 
student's comments, does the teacher of literature hear the skeptical 
"UTiere did you get that idea from?" or the frustrated "I can't get any- 
thii 3 out of a poem (or a play or novel)?" Often enough, it seems to 
make the most traditional instructor want better ways to lead a student 
into understanding for himself what there is to literature. One such 
way is through formalism — - the close analysis of the structural elements 
of a work of language art, an analysis grounded in the premise that form 
and meaning are mutually interdependent and that, in fact, form creates 
meaning.! That formalism can be effective in a classroom discussion 
of short poems is generally accepte.d. But the same analysts who 
acknowledge this use of the technique are quick to add that formalism 
cannot cope with long xcorks , especially with the novel: lengthy books 
of prose fiction are too unwieldy to be dealt with adequately by the 
formalist's approach, and, these writers like to add, the novel relies 
less on formal devices and more on ideas, social concerns, human 
interaction.^ This summary of the case is far too negative, for two 



More detailed definitions and critiques of the school — as well as 
examples of its application — can be found in various handbooks of 
literary criticism. For example, see Sheldon N. Grebstein, Perspectives 
in Contemporary Criticism (New York, 1968), pp. 75-160. 

For instance, see Grebstein, pp. 75-84. 



* Assistant Professor of English, Cleveland State University. 
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re^)ons. The most realistic, nineteenth century novel (the kind defined 
as "the novel'* by those antagonistic to formalism) is highly structured: 
ideas and social interaction are limited and defined by formal elements 
which cannot be ignored by the reader and which, in fact, he must care- 
fully examine. Furthermore, a formalist approach in the classroom not 
only succeeds with works larger than the lyric poem but also offers an 
opportunity for inductive learning. The same students who, under the usual 
classroom arrangement would be unable to present cultural and historical 
backgrounds, to define genre, or to deal with literary tradition, can 
participate actively when asked to confront the work in front of them. 
Passiva attention (or non-attention) to an analysis which may seem based 
upon the automatic application of prefabricated generalizations is 
replaced by direct involvement in their o\m learning experience. The 
role of the instructor is then refocused to that of resource, guide, and 
fellow student, and teacher and class join together in an experience 
of mutual education. 

To a degree, we in literature all recognize some such philosophy: 
we may give introductory lectures on the period, on the genre, perhaps 
on the author; we define terms and offer theses; then we turn to the 
class and begin to ask the questions which x^ze hope will lead the students 
into the poem or novel, guiding the class in i more or less preconceived 
direction as it finds its way through the work — if it is actually 
"finding its way'* rather than being shown "the" path. Even when we 
r^-stablish a more inductive approach, we do not carry this option nearly 
so far as we might, and thus we vitiate an opportunity for education in 
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Its original sense: the drawing-out of knowledge in the student. A 
laethod which enables the student to draw from the work at hand all the 
material within it, would allow him to discover for himself all that we 
normally would try to ^^teach'* him; the forms and concerns of the 
particxilar work; the interests, ideas, and techniques of the author; the 
generalizations about the time and culture which usually form the 
central concerns of at least introductory lectures. At the level of the 
individual work, formalisn), through its close and objective analysis 
of the work, provides a means for inductive learning. But a whole course, 
too can proceed in this manner « A problem Is posed or questions are 
asked, and the students attempt l:o find solutions by examining a series 
of works in close detail, using as little external information or values 
as is possible. 

A course designed on such a model would have in a preliminary lecture 
only the establishing o£ the problem to be solved by the class and some 
ground rules (to be determined with the help of the class, if possible). 
It would then proceed through close inductive analysis of the individual 
works — relying primarily though not exclusively on formalistic means — 
both to deal with each play, poem, or novel, and to formulate solutions 
to the defined problem. The r-.l^ss should not be asked to deal with a 
question for which the instructor has a set answer or for which a definitive 
answer is available. Thus, fruitful options could include the definition 
of a period (What is Modernism?) or a Genre (I-7hat is an Epic?), the 
exploration of a theme (What has been the effect of various structures 
of the drama or the novel?) or a critical method (I^at can sociocultural 
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criticism offer to an analysis of nineteenth century drama?).* In coining 
to grips with each work the class V70uld also be grappling with the overall 
probleia posed in the course design, and might very well add to or move 
away fros this problein as new areas opened up. 

In the Spring of 1972, a seminar with no preestablished content or 
design provided the opportunity to put these precepts into practice to 
a greater degree than ever before. The course was set up as an inductive 
attempt to define the novel by looking at a series of eighteenth and 
twentieth century works which threatened to burst the bounds of such 
traditional concepts of the genre as used above (the "realistic^*, nine- 
teenth century variety of novel) • The key word in that brief description 
is inductive ; a variety of standard (and non-standard) definitions of 
the novel were examined and found wanting, and the class was forced to work 
with — and constantly to evaluate — a series of tentative notions. With 
one "novel," The Waves by Virginia Woolf , we chose to test a fully inductive 
formalist analysis, follov7ing ground rules far more stringent and limiting 
than those which would normally apply. Because of its unusual style 
(passages of prose-poems in italics alternate with the self-contained 
interior monologues of six speakers) , this modern work seems to be one 
which requires strict and absolute ci-tention to fo™, but critics have 
consistently sought to impose upon interpretations neither derived from 
nor fully consonant with its extreme and "'.r.iquc formal elements. 

^Obviously, the precepts of the "psychological theories" or of sociocultural 
cri':icism would need to be introduced. However. '.*:ese too could be dis. covered 
directly by the student from primary sources (which, for the sake of 
efficiency, would be chosen by the instrur^or). The approach to the 
literature itself, can, of course, r-?.main that of the "new critics." 
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The class set up the following guidelines or rules: (1) no outside 
references other than t^ose needed to chtsclc allusions or def ini'/:ions 
within the text; (2) no references to the novelist, her life, opinions, 
other v/orks (fictive or othen/ise); (3) no introduction of outsidv^ 
laaterial, such as historical, philosophical, or cultural precepts aboit 
Modernism. The students (and teacher-student) agreed to keep notes ot 
points whicii they would have brought up in a different classroom cor4'ce":t, 
of questions which they would have asked or which once asked were not. 
answereid-^atisfactorily , and of any losses they felt to arise from the 



Probably unav/are that she was doi.ng <30 , one student echoed a 
traditional argument against formalism when she observed, on the day before 
we began our discussion, that the novel was too long to allow for the kind 
of full, word-by-word analysis accorded a poem. And. on the first day, 
after spending some forty-five ninutes on six sentences from the two- 
hundred page work, we vjere in f\ill agreement. But the impossibility of 
total comprehensiveness is barely an argument against the approach, for 
any analysis of a novel in a limited time vjill necessarily be incomplete, 
and if formalism is as complete as traditional nodes while enjoying 
additional benefits, then its value cannot be challenged on those grounds. 
Rased on class response, an inductive use of formalism is successful « 
If we had more time, vre could fact have dealt with more, but even 
within the limitations present, th^. sfpnroach led us ^ore accurately, more 
sensitively, and more satisf actorilv info the novel. 

It would be impossi-ble and inanpropriate to reproduce the class 
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discussions here, but soine samplGS r^nd soriG generalizations* seem 

necessary. On the first day, we isolated the topics to be coveredo' 

verbal style 5 point of view, strticturej the italicized sections, image 

patterns, image sharing, character juxtaposition, "piot^^ (or what ■ 

substituted for it), internal geography, the nissing heto* Our discussion 

of verbal style, the first point, got us into the lengthy analysis of 

the six line section mentioned above. After the first introductory 

Italicized section (the work of an omnnisciGnt narrator whose only other 

function within the novel is to indicate the speaker, by noting '^said 

Bernard/' *'said Rhoda." and so on) ^ each of the six narrators ^'utters" 

one brief "speech in turn: . - 

Gee a ring,'' said Bernard, ^^hanging above tne. It quivers 
and hangs in a loop of light/* 

"I see a slab of pale yellov?/* said Susan , ^'spreading away 
until it meets a purple stripe/' 

^'I hear a sound/* said Rhoda, ''cheep, chirp; cheep, chirp; 
going up and dmJn/' 

"I see a globe," said Neville, '^hanging down in a drop against 
enonncns flanks of some hill/'' 

''I see a crimson tassel," said Jinny, '*twisted with gold 
threads/' 

"I hear soinething star.ipingj" said Louis. "A great beast's 
foot is chained. It stamps, -and stampSs' and stamps/' 

The speakers are infants at this point; throughout the novel, we decided 
(on the basis of the content of thc:i individual monologues and the relation- 
ships among them) ^ their words ::eveal a pre-verbal level of thought made 
verbal in order to establish thematic points about hui^ian nature and human 
cozTJiiunication. la these six liner- r^ould idetitiiy (in retrospect) 
images 'which signal each character jghc/Ut Kie work (Jinny's rich fire 
colors, Louis's chained beasc) , and tho.:e wiiich achieve special 



significance for the six as a group (the ring which eventually coines to 
Suggest a circle of human unity) . The rhetorical parallelisms and sound 
repetitions of these lines helped to suggest the impact which form has 
in the work, and the nearly identical patterns of syntax and diction con- 
tinued in the rest of the opening chapter provide the first indication 
of a straiige unity among the six speakers. Words and phrases such as 
"purlieus," ^'reprieve from conversation," "stricture and rigidity," and 
"oleagino\jo spots," used when the socakers are no more than six or 
seven, suggested again that the utterances could not be regarded as speeche 
thoughts, or stream-of-consciousness. 

From this beginning ^ we worked our way tlirongh the other topics, 
adding new ones which arose from class discussion. From a study of 
repeated images we were able to develop a sense of cliaracter identity, of 
the speakers' ambivalent attitudes tovjards nan, life, love, nature, and 
death, of human interaction and communion at sone cosmic level. From 
sentence structure we recognized the similarity among the speakers. 
From the dual structure of the book (tlie alternating italicized sections 
and interior monologues) gre'.v our sense of the significance and 
limitations of perspective as well our acknowledgement of the book's 
assertion of the cyclic form of human and natural liff:;. And slowly, by 
delving into one after another of t'yose. technical quantions, we were able 
to build towards a considernr ion of imnact "":d meanings : to recognize 
and identify the questions which tho novel raises about the possibility 
of knov/ing oneself or another, about -'^r significant limitations faced 
by the individual — v;ith his sinj^la point of viex-; and his single life. 



about the links which exist anong six vho shara a common past and hctwoen 
them and all men, and pre-eminentiy , about the iinitationn , problenis, and 
values of the novel as an art form. 

One of the characters, Bernard , Vias a lot to say about this point, 
asking, *'Are there stories?" and suggesting that *^lii:e is not susceptible 
perhaps to the trcatrnent we gi'^e ll vhon we try to tell it/' But he need 
not have said this overtly, for, as V7e discovered, the novel says it through 
form. And it is, we decided, ^superfluous (though interer^ting) to turn to 
A Writer's Diary^ and see Virginia Voolf sayinp, it ar;ain. It is 
interesting to contepiplate a re3 ation-'^rrlp botvjeen Bernard and Virginia 
Woolf, to note that in Bernard^ ^: qunric.^ r.bout art are reflected the 
doubts and fears of Mrs. Woolf and h^r contcu'sporaries , and in .his 
perseverance, their o^m faith in cxp^-rir.entation. It is of historical 
and cultural significance that t:he noval shores with those of its period — 
and with the non-literary outpvit of the early tv^intieth century — a 
questioning of basic humanistic values. And, so on. 

We did lose some of tliis (t:hcu;:h we could nahe it up at the end, 
thanks to the not^js we all ro,o]:; , Hut ^7]:at vc ^.p.ived far outweighed 
the loss, and in the normal classroon r:et-.r.-i nf; , such a dcgrriatically one- 
sided approach x-^ould not be nocnssarv. "h'.-- i^r-cuvacy and insir/nt afforded 
by formalism would he. si;pplcri'.:n -lo-* .■ v ''■-•r lnj. fror-: o'oher approaches: 
history, philosophy^ psyc]i'^.lr^j;;y , -n-] i.':e-r.:iry ^rts^ and the like. 

But even with the self- It.!) c n ■ : ' ' ; ■ - •■. t-; ^ - ; - ^ * • ^ , ..^ ^ - 1 e n c e \: as positive. 
Our analysis was accurate: -jo civoi:],-.} "- Ips and a superimposition of 
critical precepts or personf?il precon -cpc uwis nivnut tlie wr^rk. It \ras 



-20A- 



sensitive: we came to grips with the book in its own terms and with full 
appreciation of its strengths and weaknesses. And it was satisfying, in 
part because we were able to combine the basics of several areas — 
aesthetics, literature, language and literary criticism — into an unusually 
comprehensive analysis of a large, work. Finally, it was exciting. 
Class discussions frequently ran over the assigned periods, one student 
became sufficiently involved to consider adapting the novel into a play, 
and students in evaluative consents indicated generous approval of the 
experiment. Specifically, students appreciated the ''discipline" which 
was enforced through the emphasis upon objectivity and concreteness 
(absolutely no unprovable thee rising was acceptable) , and noted the 
"added dimension'^ given the course b^-' a variation or approach. Further 
values were seen in the Introduction of ''nev; critical tools" to the class, 
and in the unusually vivid demonstration of the strenp.ths and weaknesses 
of a major critical school. In view of these features, one student 
recommended that a series of such experiments, involving various modes 
of criticism, be adopted in a future course". 

This class was an unusual one: eight students (plus frequent 
guests), all of \'fnov^ were involved and interested in the subject. How- 
ever, judging by the increase in class response^ by the students' 
enthusiastic, intensive work^ and by their rommentSj the method is 
successful. i\nd, in a class in which students are skeptical and 
uninterested, the approach offers added values. Through the application 
of formalism, the questions and com.plaints with which this paper opened 
are answered: the student can ree "where* . . -'.hat idea" came from, and 
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should no longer be unable '*to get anything cut of the poem, play, or 
novel. He should be able to see how a work of art (and not just a short 
lyric poem) is put together, and hov it uses various techniques to achieve 
impact and to involve^ its reader (or listener) intellectually and 
emotionally. The most disaffected student (assuming that he is not 
uninterested in all mental activity) still stands to ga^ something from 
thirl nethod, for he can learn a means of inductive analysis which may be 
vc^b.ic^bi*? in fields other than literature. IvTiile formalism per se is not 
transf^vrable , the inductive method (borrowed from scientific research) 
can be apvli^t^v' to the understanding of an event or period in history, 
a social phenomenon ^ or a philosophical question, as well as to a play, 
or |voem, or rovel. Working out from x>rithln, paying close attention to 
the elements of the problem or the work under consideration, discovering 
for hir;iself what the questions are and how they can be solved: all of thi 
involves the student directly, challenging him with a problem v/hich he 
can solve for himself and yet which is, in fact, a challenge, and 
allov;ing him to participate in — and in some ways determine the quality 
Df-^'-hiS own learning experience. 
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TEACHING ONESELF TO WRITE A POEM 
A. Turner 

At the risk of angering both poets and pedagogues, I begin by 
'^suming that the ability to write a poem is as universal as the ability 
to use any other form of verbal communication, and that like any other 
form of verbal communication, it can be taught — in a classroom. It can, 
of course, be self-taught outside a classroom. Rut I share with my 
colleagues the belief that classroom technique can increase the speed of 
self-teaching if^ it remains inductive. The following course in poetry 
writing is planned to facilitate the self-teaching process by a series 
of sequentially arranged exercises in which the beginning poet is lured 
away from the habits of expository verbal communication — the essentially 
deductive methods of thesis statement ^ expanded by definition, analysis, 
example, comparison^ etc., according to the rules of classical rhetoric. 
Instead, he is encouraged to use the method of affe ctive communication — 
the essentially inductive method of combining words by free association, 
then examining them in order to discover what they have said and the 
principles by which they have achieved their affective force. 

The recognition of a need to wean beginning poets from the habits of 
expository to those of affecti ve \'erbal cor;::' Jinication is based on the premise 
that the function of man's intellect i?i to pnttem his diverse perception<; 
of experience; that he uses these patternirgs either (1) to regularize 
experience and so protect himself or (2) to surprise, disturb, and so 
energize himself. In verbal communica*:ion this means that he uses words 
in their regularizing function to fulfill n^cial expects^tion: to write laws, 

* Associate Professor of English, Cleveland State University 
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contracts, business letters , interoffice memos, news and research reports, 
textbooks. He uses words in their energizing function to write plays, 
novels, jokes, short stories, poetry. And he combines the tx-70 uses in 
advertising^, editorials, reviews, sermons — wherever feeling needs to be 
disguised as reason or reason needs the siipport: of feeling. The poetry 
of the Renaissance was taught as such a combination. Poetry x^7as conceived 
as rhetoric in the service of logic, as an extension of persuasion. This 
concept is still held by a large segment of the population. But the 
practice of mid-twentieth century poets continually denies that the poet's 
feeling should be expressed in the socially acceptable forms of reason or 
rationalization. The function of poetry today, as he sees it — and writes 
±t — is to shock. 

To create this sense of shock in a reader is extroraely hard if a poet's 
verbal reactions to feeling (at loast all :hos^ he is willing to see on 
paper) are conditioned wholly by clasF^room analysis of what other poets have 
put on paper. Even the. most assiduous study of Ginsberg's "Howl'* puts 
poet-as-reader at one remove (if not more) from the direct experience which 
produced "Howl," He cannot himself ;:ov;l unless his o\m toes has been 
stubbed. But he has probably never howled on paper when his own toe has 
been stubbed. The point of this sequence is to make him howl on paper 
before he is even aware that he is hov^ling, and only then to Icam to control 
his cadences. 

The introductory exercise of the sequenc/^, , therefore, stresses the 
value of free association^ Sing].e :;cr<]fi are used, since single words 
associate more freely wi'ch ^ach other than vcruj already embedded in 
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sentences. Concrete words are used, since abstract words convey little 
':ncaaing unless abstracted from th^, experience represented by con'trete 
words • 

The remaining exercises are grouped (Part I) under literal meanings 
of words and (Part II) noa-literal meanings of words, on the assumption 
that a direct sensory perception precedes the substitution of that 
perception by a non-sensory perception: l^.e^. the word cat for the anirnaL 
cat before the word cat for the feline personalit y traits of a go ssipy 
nei ghbor ^ 

Though I realize that isolating poetic principles and teaching them 
in sequence is artificially neat compared to the complex process of 
writing a poem and virtually impossible in the sense in which scientists 
isolate and sequence principles in the laboratory, I believe those 
principles can at least be pointed to and talked about one at a time* The 
student will be performing the ^^ole process every time he does any of 
the exercises, but he will become aware of what he is doing only gradually 
and in small enough steps to acquire control — the power to revise his 
random jottings in order to realize whatever pattern he sees suggested 
in their initial mass. 
SEQUENCE OF EXERCISES: 

Part I': Literal meanings of words 
A. The value of con.ci ateness 
R. The value of rhythm, 
C, The. value of spacing. 

Part II: Non-literal meanings of words 
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A, Repetition that does not repeat. 

1. The value of allusion.- 

2. The value of opposites. 
Metaphor 

1. Not the same, but recogn.^iiably similar. 

2. Absurd, but not quite. 

C, The value (and risks) of ambiguity. 

Depending on the age and literary sophistication of the class- 
furthsr details of technique can be introduced and reinforced in group 
discussion of the students' own poems written in response to the exer- 
cises. The proces*^ of polishing them after they are put on paper will 
be much the same as that now used in private and academic workshops all 
over uha .;:cuntry. 

The chief innovative function of the exercises is to start poems, 
to surprise t v. students into writing them, into discovering that they 
have written them. What they learn by this method will have been in a 
very real sense self-taught, 

INTRODUCTORY EXERCISE: The Value of Free Association and the Importance 

of Stiqucnce 

1. Ask students to lisi. rhf. ':"''-":^L eigfit: things which they reiuOve 
from their pocketbooks (cr t.ockoi:?-; *r Lhe order of their 
removal, uhen to rearrange t' e list in the order of increasing 
iraportance to the ox'Tner . 

2. Have rhree or four of these lists vjritten on the blackboard.* 



* These will be poems, thpagb. it is not ne«^eFsary to use the vrjrd, 
even inadvisable, if the cl..ss is a high school or freshr.ian colle 
class. Just call th^:=i)i word rx rc -^-.s- 
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3. Ask students other than the authors to explain what each list 
shows about its author. 

4. Copy on board the prose explanation of each "portrait.'* 

5. Ask students how the explanatory equivalent differs from the 
original list. (Hopefully, the comparison will evoke 
observations that the poem is more compressed, more specific, 
roore fragmentary, more concrete, more emotionally intense* yet 
quite as psychologically accurate as the prose equivalent. No 
generalizations about poetry, however, need to be made at this 
time. The same observations wil7. be made and need to be made 
again as the result of other exercises. Generalization tends to 
become dogma at this stage and should come as the result of all 
the writing exercises, at the end of the unit.) 

Example : 

Original list: List in order of increasing importance 

lipstick lipstick 

Kleenex Kleenex 

4 keys Wrigley wrapper 

postcard from Spain lOc 

10 cents dentist appt. 

Wrigley wrapper library card 

dentist appt. postcard 

library card Spain 

KEYSl 

Typical reactions \;hich can uc ^.-cprrlcsd froc college upperclassmen 
to a comparison of the two lists: 
"She wants out." 

"She moves from trivial, everyday things to romantic escape." 
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"The position of keys in the first list suggests locking in; in tha 
second list it suggests unlocking, letting out/' 

"The poem taoves from minor everyday restraints like putting on a 
public face to major ones like paying library fines and having your body 
jerked open by a dentist; then it turns away from all that." 

"The capitals on Wrigley and Kleenex are gone, cents an*^. 
appointment are just abbreviations in the second list, but KEYS is all 
capitals." 

"See how the words at the end start spacing out as if reaching 
toward Spain." 

At this point you can elicit the remark from students that each 
list has drawn a portrait of its author, and you will be able to show 
the technical value of sequence in producing each portrait. Repeatedly, 
you will find that the person who wrote the poem did not realize what he 
had said about himself until the other members of the class had pointed 
it out to him* He could, therefore, not have written the poem by the 
method of thesis: amplification. 

Other free association exercises \ohich can supplement or be 
substituted for the above: 

1. Ask students to OTite down the first six words which occur to 
them after the instructor has clapped his hands (or yaimed or 
throvm something in the wastebaskeL or — ). For example, I clap; 
the students write: 
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Student A. Student B. Student C. Student D. 



up out hi good 

bright scatter come you can do it 

red shots happy more 

now hit me hot yes- 

do no firecrackers push 

go there bang fun 



Ask students what unity (feeling, inood, attitude, pattern 
of any kind) they find in their sequences. Ask if a sequence 
can be rearranged in an order that will make its unifying 
factor more evident. Ask how the rearrangement has made the 
unifying factor more evident (compare with other rearrangements 
which do not reveal the unifying factor so well) . 
2. Have students take turns drawing six words at random from a deck 
of cards, each cf which bears a concrete word, with several 
universal connotations. For example, black , white , red , green , 
blue , sea , sky , gra <4^j ^ rain ^ wet ^ d ust , fur ^ hot , warm , cold , 
dry , fish , mouse , deer, do^g^, whale . Have each student arrange 
the six words in a sequence of increasing importance to him. 
Have several of the lifjts put on the board. Let students note 
what each sequence revnals about its author. Let instructor 
take advantage of this opportunity to show how the different 
ordering of words has suggested the different attitude, concern, 
or personality trait of the author. 

Suggested homev7Qrk assignment (to follow any of t he above exerci ses in 

free association and sequence) ; 

Ask students to visit a person's rconi (bedroor>. study, playroom. 



-213- 

garage, kitchen). Ask each to write dox^ the first ten things in the 
room which strike his eye, in the order in which they strike it. By con- 
templating the close up list, he should decide what characteristic of the 
owner it reveals. Ask him then to rearrange the list in such a V7ay that 
this characteristic is emphasized. When the results of the assignment 
are passed around or projected on the board, the class will try to 
determine what characteristic or complex of characteristics the lists are 
arranged to reveal. Both success and failure in making these characteristic 
evident can become the basis for constructive criticism. 

The principle which can be drawn from the free-association and 
sequence exercises, preferably by rriGmhers of the class, is that the 
associations of the human mind are never really random, that feeling 
(p.ttitude) imposes a pattern on any material presented to it from outride 
or dredged up from the subconscious j that we d iscover whc^t we mean 
before deciding v/hat we mean. 
PART II:* NON-LITERAL T^ANINGS OF WOPDS 
Exercise A: Repetition That Does n't Repe at 
1. The value of allusions 

a. Write on board a typical newspaper want ad; 

Good home wanted for expensiV'^. beagle 
bitch: good watchdog, neviii: strays, 
protects children^ keen iiCcc\. pedigree, 
ail shots. Avaiiabia once* 

* Because of the limited spac2 in the I.T.G« anthology, I shall 
not detail here all nine of the exercises which comprise the 
rest of the sequence^ but shall eive three to illustrate the 
method. The rest will be furriished '^n request. 
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Substitute the word mothe r -in-law for beagle bitch . Ask why the 

ad in its first form was not funny (familiar, expected), why 

fuuny in its second form (unexpected, yet apt. It fits a bitchy 

mother-in-law). Ask what would be the relative effectiveness 

of an ad reading: 

Please, somebody, take my mother-in-law off my hands. 
She never leaves the house, nags the children, meddles 
in ray business, talks endlessly about her family 
pedigree, and is impervious to all hints to leave. 

(It would be less effective because the author has just stated 

the familiar complaints in a familiar way. The familiar went ad 

and the familiar complaint were more effective when used together, 

^.e^. , the familiar in an unfamiliar term). 

b. Write on board a typical lost-and-f ound ad: 

Lost: one black patent leather purse containing 
keys, a Halje's charge-a-plate and a change purse 
with fifty cents. Call 534-7236. Reward. 

Change it to: 

Lost: one brown-haired head containing cents, 
Saturday's horoscope, and three defii;itions of 
a minor poem. Call 111 -1111 ^ Reward? 

Is the author complimenting himself? Vfnat is he saying about 

himself? How does the form help him say it? 

Change it again to: 

Lost: one rat cheese, containing Peter Rabbit, 
three gallons of kerosene, and a ret. Call six, 
call six, reword. 

Is the author I*ere sayin?> something about himself? Is his mood 

serious or funny? Kow does the form help hira say it? 
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c. Have each member of class write three lost-and-f ound ads, 
putting down at random the first things which come into their 
heads. Have them choose one which seems to express a feeling 
or attitude and modify it to heighten that feeling. Have three 
or four written on the board and ask class if they can tell 
what feeling each expresses. If they can't or can tell only 
;.artially, asV. class to help author u-ork it toward what he 
thought he was expressing. 

The general principle Xv^ich can be drawn from this exercise is that 
the expected form itself says by long and familiar association > much of 
what the author would othen^ise have to put into his poem. For instance, 
the lost- and- found ad form says "I am aware of a loss, aware that losses 
are usually abbreviated and made public with expectation of repair." All 
that he adds to this familiar form is the implication, "But my loss is too 
great for either accurate naming or external repair. I've lost me, and 
I'm amused" (no. 2), or "I'm lost and I'm frantically groping" (no. 3). 

d. Ask class to make a list of all the traffic signs they 
can think of which contain the word ^o. Taken separatt^ly^ 
what does each meaa? What is the purp^ose in posting them? 
(Safety.) Have class make a list of five or core of them 
which, together, will mean somothing different from what each 
originally meant. 

Example; 

Random list: Lict in order of mounting frustration: 

no stopping no -horoughf are 

no exit no ;';toyping 

no U turn no ^^as?.:^'^.g 
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no parking 
no thoroughfare 
no left 
no right 



no left 
no right 
no exit 



no U turn 



no passing 
vo entrance 

List in order c\f increasing compulsion: 
no exit 

no thoroughfare 
no passing 
no U turn 
no left 
no right 
no stopping 

List of antitheses, in order of increasing ridiculousness: 

no stopping no turn 

no passing no thoroughfare 

no left no thoroughfare 

no right 

no entrance 



S uggested homework assi gn ment: 

Turn a familiar formula into something else: a menu, a medical 
questionnaire, a list of street names, an application for a driver's 
license. Again, begin by randomizing your imaginary questions or names 
of foods or names of streets, etc. Only the i'Dnn will be familiar to 
your readers. I^at you fill it with should be your own unplanned, 
spontaneous outpourings. After j, and only after, they, have poured onto 
the paper, should you decide what you have said and arrange them in some 
way to emphasize it. 
Sample result of assignment: 



no exit 



QUESTIONNAIRE 



-217- 

Is it white 
Were there two? 

Have you shells 
Ar- :hey sharp? 

Could you reach 
Have you seen? 

And still tell 
Black from red? 

In from out? 
In? From out? 

PART II: NON-LITERAL hfEANINGS oF VJORDS 

Exercise B; Metaphor 

1 . Not the same but recogn izab ly similar 

a. Begin by asking, ^'Suppose you enter a room and find on the table 
one empty paper cup, one sr^ndwich wrapper, two coats (one male, 
one female), two pairs of boots, two piles of books. The light is 
on and the door is open. (Write these details on the board.) 
What would you think had happened?'' (The response should be some- 
thing to the effect that a boy or a girl had probably been 
studying alone and had been joined by a boy or girl friend. They 
have probably gone out to get iP.orc food. They will be back to 
study together soon.) Add to Lhct list already on the board; '*two 
full cups, two fresh sanm/iches, bey and girl, 'studying' together 
soon/' 

b, *Ask class to suppose that p. poet Trtakes the following substitutions 
for coats , books , food co iv:n:.nors (o'lg.^^/^M-.-'.g domestic comfort, 
purpose, nourishment) he substitutes two sil'- tents ; for boots 
(suggesting separatene53s arrival. i' rparture, aggression, flight) 
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he substitutes two dogs ; for the fact that the boots are now off 
duty, yet waiting in readiness, he substitutes sleeping dogs; for 
the light of the room, he substitutes one moon ; for the warmth of 
the room, he substitutes one fire ; for the attraction between the 
boy and girl, he substitutes one fire (in a second sense of the 
word) ; for the open door, no substitution of the actual word will 
be necessary, because its position in the sequence will now suggest 
other meanings of door (the way, the opportunity, the attraction to 
enter; sex); for the expected sequel, the poet rmbstitutes one 
silk tent soon. 

T\<J0 silk tents 
two sleeping dogs 
one fire, one moon. 

One fire, one door. 

One silk soon. 

Ask what emotional reaction the poet has had to the facts. (Romantic, 
warm, comfortable). Ask what other poiisible reactions to the facts he has 
deliberately excluded. (Indignation: these people are indulging themselves 
instead of studying as they should. Or condescension: the tawdriness of 
love in a cheap and hackneyed setting could have been emphasized.) 

c. Ask class what substitutions could be made to emphasize (a) the 
cheapness and banality of the lo\'e, (b) the shameful betrayal of 
academic duty, (c) any other emotional reaction they may have to 
the scene. Allow ten minutes to do this, then have at least three 
put on the board for discussion. 
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Sugges ts; d hoTr.ework assi|;nment : 

Give students the bare facts of a scene which the instructor has 
observed and which has moved him deeply (ju'?t the bare statistics, not 
his reaction to them) or give thtm the bare facts of a news story which 
has nov€:d him to recognizable anger, pity, fear, laughter, etc; then ask 
them to make substitutions of objects physically unrelated to the actual 
incident, but evoking the same feeling, ^-_e- the same kinds of substitution 
as dogs for boots , tents for domestic comfort , (The value of this assign- 
ment should be to show the difficulties of private versus public connotation 
and between fresh metaphor and cliche.) 
2 . Absurd , b ut not quite 

a. Begin by telling class that the purpose of today's exercise is to 
be as wildly, absurdly nonsensical as possible. Tell them to let 
go and write down the first thing that comes into their heads in 
response to the request, "Make me a crazy sandwich;'' 
Exaraples : 

1. Clouds and violets salted with bees. 

2. Glue and beetles, any bread. 

3. Spam between thick gloves. 

4. A day and a night; 
another day, another night; 
stars, dawn, a blue sea 

5. Thick finger between teeth 

6. Patsy, then Dick, father and mother 
spread over," 

then Uncle Rich 

7. Crunch and crackle, 
cream cheese. 
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b. Ask students to identify the sensation suggested by the parts 

of each sandwich. For example, clouds and violets are delicate, 
natural things; together they are associated with dreams, spring, 
romance, sweetness; salt is tang, sharpness; bees suggest romance, 
business, and sting. This first sandwich would suggest a complete 
emotional meal, even if literally it could not be eaten. No. A 
is a Dagwood of many layers, starting with the ordinary routine 
sequence of day and night (bread with nothing between) , then 
surprising with pleasure, hope, and finally clarity. The fact 
that the top of the pile is sea , rather sky , suggests the meta- 
physical possibility of clarity being also death. In No. 7 
crunch and crackle suggest the crispness of the initial experience 
of biting into this sandwich* Cream cheese makes the heart of the 
matter, the center of the experience, which is smooth, sticky, 
bland. 

The principle re-illustrated by this exercise is that nothing the 
human mind conceives is total nonsense when analyzed by that or another 
human mind. Every crazy image or combination of images represents at least 
an attitude* In addition, each is, vhen looked at closely, a m etaphor . 
In each of these examples it is a metaphor not by rational choice, nor yet 
by accident, but by the process of subconscious choice which makes a 
person react to touching an unfamiliar substance before he knows whether 
he has reason to react that way or not. An unsophisticated class will 
be able to be just as wildly suggestive as a sophisticated class. 
Suggested homework ass i gnment: 

ERLC 
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Ursj.j rae a craz}^ picture of God; stroke ma a crazy fur; build me a 
crazy house; draw ine a cra5:y porticait of yourself. Be sure to nako the 
crazy thing first; next decide what it means , and only then tinker \7ith 
it to viake. it isean even nore what ±z means • 
CONCLUSION: 

These exercises can take as much time as th(i instructor vjishes or the 
sophistication and interest of the class permit. They could be used one 
each day for a week, repeated on consecutive days for a week, used one each 
xveek, interspersed with class sessions, »;Thich either take the forni of work- 
shops in x^hich students react to each other's work or the form of critical 
discussions which examine published poems. For exarnple, Auden's "The 
Unknown Citizen'* can be used with the exercise on the value of allusion 
for creating irony; Michael Benedict's "Divine Love" is a fine illustration 
of a "crazy" picture of God. In other words, these exercises in 
discovering what poems are tnade of by writing them can be as useful in 
learning to read poetry as to write it. The chief difference between 
using then in a literature course and in a writing course would be that 
in the literature course one writing exercise and at least or^^ scadent 
i-yriting assigntuent might precede a week of reading published poe^s; in a 
writing course a week n€ x>7riting and analysing student poens would include 
a few published ones to be criticized at the settle time and by the 
same criteria as the student poems » The emphasis would be different, 
but the lasthod the sane. 

l^^or does the method need to be limited to English courses. If free 
association can successfully initiate poems, why, J asked tTiyself , can^t 
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it initiate hypotheses in other fields* After all, isn't "having an 
idea/* any kind of an idea, r^imilar to detecting the pattern of an 
emerging poem in free-associative material? Here, of course^. I^ra 
skating on very thin ice* I don' know other fields, so, for fear of 
making a fool of myself I shall only throv out a very few tentative 
questions. In fact, sor.i teachers may already have used free association 
in their classes, more extensively than !• I have heard of artists 
using it to begin pictures: a pen'il doodle to suggest figures; an 
inked string to make a pattern on the unders.ide of a piece of paper 
which is then turned over and "edited" or developed into a picture; 
the grain of a block of wood to suggest a sculpture to be carved from 
that woodc Though I have no experience in the field, I see no reason 
why the same process could not be applied to the composition of music. 
In fact, the cutting and splicing of tapes in making electronic music 
is in a real sense an editing of free-associative sound to produce 
controlled pattern. 

In areas of non-affective conmiunication, such as the social or 
natural sciences, I can see free association as a useful device for 
unclenching the mind in order to invite new hypotheses. Suppose, in 
a class. in psychology or sociology, one should show a large picture of 
a strongly emotional face — a face which seems to be looking accusingly 
at each student in the class. Suppose, then, one asks the group to 
write down as fast as they can what they think that face would be saying 
if it were speaking. A comparison of these lists could be used to 
provoke discussion of the extent to which social and physical stereotypes 
produce stereotyped responses, the extent to which individuals can be made 



to feel guilt, even though they* re not guilty, or a discussion of the 
nature of guilt and how it is created. 

Or suppose in a class in economics or marketing or advertising, an 
instructor asked the students to put dox^ the first twenty-five words or 
phrases which come to their minds when they hear the words meat , beans , eggs 
(one at a time, in three lists) • From the singling out of corresponding and 
contrasting details from the lists, the instructor could lead the students 
to make such observations as "The asGociation of beans with poverty has 
obscured their economic and dietary value;" "The fried egg is all that 
people think of when one says eggs . " These and similar remarks would 
provoke such hypotheses as, "Social Prejudice gets in the way of satisfying 
real economic and nutritional needs," Such a hypothesis could then be 
tested by individual student-initiated field projects. 

I repeat: these exercises are not a complete course. They do not teach 
all a poet needs to know about meter, structure, phonetic intensives, tone, 
irony, etc. They are not designed to fill a whole quarter or semester. They 
only pry up the lid of the poetic process. They teach the student that if he 
begins with his own verbal free association, watches for emerging pattern in 
these (i.e. sequence, repetition and the interruption of repetition, expectation 
and the frustration of expectation), he will find that he has written the rough 
drafts of poems. With time, patience, and ample discu^jsion guided by an instruc- 
tor alert to take advantage'^ of both successful and unsuccessful poems to illus- 
trate poetic principles, the initial free-associative lists v;ith which the studen 



* I recommend that the instructor who teaches these exercises do each of the 
assignments which he asks the class to do and submit his own efforts to 
the class for criticism along with theirs. He will thus give credence to 
the idea that poems are discovered before they are composed and that the 
process of discovery is much the same for the amature and for the profession- 
al. His students will also find that the raw material from which they 
quarry their poems is much the sam^ as that from which he quarries his own, 
and in no way inferior. 
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started vlll begin to sharpen and to shape, and after working through the 
exercises he will have enough understanding of what has happened in the 
initial, unconscious steps of writing his poems to become a more controlled 
craftsman in the final stages of polishing them. Even if he never becomes 
a professional, he should have enough understanding of what goes into the 
making of a poem to read professional poetry as poetry, instead of as 
expository prose. 

In conclusion, free association is induction at its earliest stage. 
It produces the material to be identified, compared and finally generalized 
about. It is not anti-intellectual. It does invalidate all of current 
classroom practice, but if it is used as the first step. It motivates the 
student by making him discover for himself the principles which, if 
lectured to bin, might leave him with the feeling that he is unworthy 
or incapable of discovering them himself. That is an attitude which a 
beginning poet cannot afford to have. I like to think it's one which the 
beginning economist or psychologist or philosopher or biologist Can*t 
afford to have either. 
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OIT TE/LCHIKG IN THE UNIVERSITY; AN HISTORMN'S RECONSIDERATION 

Lance C. Buhl * 

The function of the Arts and Sciences in higher education has always 
been to graduate men and wonien who are intellectually resourceful and in- 
dependent. And, in a highly bureaucratic, technologically sophisticated, 
r:r.sn industrial society — one which places increasingly severe strains on 
th'ii proposition that an enlightened citizenry is both viable and necessary — 
the burden on the Arts and Sciences has becorae heavier by far. The challenge 
is not to produce more highly specialized bureaucrats or technicians, except 
perbaps in the public or human services, but to educate more resourceful 
people, people who are skilled in problem-solving of a general sort and 
who, above all, have developed skills appropriate to understanding and 
affirTiing the best of our cultural heritage. 

I think these statements fairly approximate to a generalized definition 
of the value and function of higher education. None of qur particular 
def5.niticns is likely to vary greatly, \vhere we be[»*»> to differ, I suspect, 
is In the estimation of what constitutes success in meeting the goal. How 
do we m.easure the achievement of any one student? Are we satisfied that we 
have acquitted our responsibility when we can say that ten percent of our 
students have demonstrated a relatively nigh level of intellectual involve- 
ment and capability? Tx'jenty percent? Forty? Seventy? And, of course, we 
v7ould quarrel even more about where it ic: rbat success ought to be measured. 
During or just after any course, any sequence of the:?., an entire curriculum? 

My position is, first, that it is absolutely essential that each of us 
reaffirm, course by course, the commitment of Arts and Sciences to produce 
intellectually resourceful graduates. Second, we cannot be satisfied that we 



Q - Assistant Professor of History and Assistant Dean, College of Arts and 




Sciences, Cleveland State University. 



226- 



have Succeeded when only a minority of our students, 'the saving remnant* of 
the intellectually motivated and talented, meet the standard. We must avoid 
the temptation to discount the intellectual potential of the majority. It is 
a potential* I will admit, that is not often tapped. I believe it exists • 
Finally, the testing ground for each of us in public higher education is the 
classroom itself • It is the day by day development of our courses that is, 
far more than most of us care to admit, the crucible for success of failure 
in the university's overall mission. On pedagogy, on teaching, then, rests 
a tremendous and critical burden. 

Over the past three quarters, in surveys of American history since 1865, 
I have adopted a method that seeks to maximize the involvement of the majority 
of students. 

It incorporates a redefined role for the instructor. While continuing 
to serve as a certifier of performance, he has become simply one of a 
number of potentially equally valxiable and valid resources for the student. 

The method reduces the place of the formal lecture • Only about twenty* 
five percent of classtime is given over to it* The primary reliance for 
the discovery and transmission of meaning in history is placed on student 
peer groups. Structurally, the class is randomly divided into groups of 
five. Nearly, three quarters of time in class is devoted to group discussions 
of historical situations and the resolution of historical problems. 

Mastery of course content this quarter is demonstrated through five 
objective unit tests of twenty questions each and a final essay- examination 
cove-ring all five units. The five unit tests are qualifying exams; they do 
not count for grade. However, a student must pass each with a Score of 14 or 
better in order to get a grade for the course. Immediate feedback for rein- 
forcement's sake is provided by going over the answers after the score sheets 
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have been turned in. 

To prepare for these unit exams, individual students and their groups 
direct their efforts to answering five required sets of study exercises. 
These, too, are ungraded* Each exercise consists of about fifteen questions 
which demand a considered judgeinent of men, movements or events in American 
history* The questions are geared to a single text. It is the student^ s 
and his group *s responsibility to gut. the text — take from it only what 
they need — in order to develop shorty but plausible justifications for 
their answers. .Together these exercises, then, form a kind of learning 
. laboratory, not self-pacing to be sure, but geared to developing for each 
student a working orientation in American history. 

Each set of questions is developed around the broad topic area in which 
five case studies have been constructed. The case studies — on the election 
of 1868, on the Pullman Strike of 1894, on Bull Moose politics in 1912, on 
the elections of 1938 and on the J. Robert Oppenheimer case — define the 
student^s confrontation witVi history. For each study, each group is directed 
to play a particular role — citizen grov^D. blue ribbon commission on labor 
unrest, dejected party workers, presideat^ai advisors , congressional aides. 
The task is to come to some determination about the particular issue specified 
and to vnrite a short, formal report arguing the gxoup^s case in defense of the 
decision. While secondary sources are recom.T.ended -nd placed on reserve^ 
compilations of selected primary sources fo"u; the heart of investigative work 
in the course. 

A student's grade is based, not only upon Uis own study and research, but 
also upon his work as part of the group tr which he is assigned. ^ In fact, half 
the grade is the average m.ark for tb/?. :i::!.ve ;>roup "^^rrjects. Another thirty 
percent is the mark av/ardcd by the gro - r-: contribL-; :„ons to its work. Only 
twenty pc:::-^:it of the !^-rade derives from ^he score on the final examination. 
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Each student in a group is responsible for editing and otherwise coordinating 
one of the five group projects, A group that receives an average grade of 
C or less for the five projects may assign only one A and one B in evaluating 
its members » Otherwise, groups may avjard grades as they will, so long as 
they justify each award assigned. 

Finally, as a source of feedback to me and as a goad to wite creatively 
and freely, each student must maintain a personal log or daybook of the course. 
An entry is required for each day in class. The logs are ungraded. 

Now, historians and others in the humanities and social sciences will 
recognize much that is not new or extraordinary in this description. Yet, 
it is fair to say that, in the combination of parts, I have worked out a 
learning environment which is quite different from the traditional mode in 
which I passed my formal education and of which, until last year, 1 had been 
a consistent practitioner. 

At the risk of slighting what has been a rich tradition, let me specify 
what appear to me the essential features of the teaching method I abandoned. 
The undergraduate and graduate schools I attended, to a considerable extent, 
depend on the familiar recipe of instructor as authority, lecture as dominant 
mode of intellectual communication in the classroom, and the reading and 
research of relatively highly motivated students as the key to academic 
success . 

It always seemed, too, that each course was assumed to be comprehensive,- 
at least within the boundaries of its formal catalog description. In terms 
of student behavior, this meant that each individual was responsible for 
digesting all the material assigned, including the lectures, and must prepare 
to be tested somewhat randomly as to information covered. 
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Three questions seem worth pursuing to some depth. First why abandon 
a teaching method I mastered as a student and employed as a university edu- 
cator? Second, how does one come to adopt a system in which pedagogical 
staples like lecture, discussion, coercion, grading, etc. are drastically 
rearranged? Third, how. has the method worked? More precisely, has it 
worked any bet:er than the traditional one? 

The short answer to the first question is simply that tV.e traditional 
pedagogy did not seem suited to fulfilling the purposes for Arf and 
Sciences that I formulated at the outset of this paper. The long of it 
is that I had begun to suspect ^ long before I became concerned about the 
function of public higher education in general, that my own courses were 
not very effective. That is, they were failing to meet two standards 
both of which relate to the experience with history I was and am committed 
to stimulating in my students. 

First, I expect that most, if not all, my students will discover 
something of the excitement in history — in the recurring confrontations 
between man and his physical, social and moral environments — that led me 
toward a career in the field. I want at least seventy-five percent to 
leave my course with a conviction that there is something of value in 
studying history. More hopefully, I want each course to serve as a spring- 
board for stimulating further inquiry into the subject by students after 
they leave our hallowed halls. 

Second, I insist that every student in each of my courses be confronted 
with a demanding intellectual challenge. Stated another way, I am committed 
to maintaining standards of intellectual rigor appropriate to the level oi: 
course taught. How can any student experience the excitement of history 
unless he is confronted with its relentless complexities? He cannot. My 
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minimum professional obligation is to ensure that eacVi course meets 
acceptable standards of difficulty. In this way alone can students develop 
the conceptual tools requisite to a continuing appreciation of history and 
of its dilenunas. 

Measured against these standards, my courses were not successful, I 
venture the very optimistic guess that they i.ad never reached ~ excited — 
more than thirty percent of the students. Moreover, those students who had 
recognized and responded to a tough intellectual challenge constituted, if 
anything, an even smaller minority, because a number of those who had been 
excited by history had come by way of the il].usion that the discipline was 
easy. By and large, the successful students had learned quite early how to 
play the academic game: first discover how to keep alert enough in class to 
take notes that correspond to the lecturer *s signals about what he regards 
as critical; then, point toward examinations by using those signals for the 
limited purpose _of_ reading secondary sources accordingly* The key is to 
figure out the instructor and, the-.n, to develop some facility with the jargon 
of the discipline. 

The failure lay in the fact that so few of even these students had 
ever been forced to work through a difficult historical problem relying on 
their own mental resources. So, while their basic intelligence and shrewd- 
ness was certified, they remained in a more meaningful sense quite untested. 
If this were the case for the more sucrjessful students, what then of the 
bulk of them? I had to conclude that at least two-thirds — probably more 
of the studentfi had either not been capable of responding to an intellectual 
challenge or had not found one worth irie ..ing. 

Initially, I opted for the first interpretation. It seemed plausible. 
Conversations with colleagues through the years about inability to awaken 
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students seemed always to conclude that the task was impossible. Indeed, 
the pervasive assumption underlying the older pedagogy is that most students 
are not capable of, or are not sufficiently motivated in, or will not take 
the time for, accomplirhing serious academic work. 

There are some direct and disturbing consequences of this assumption. 
Because it explains typical experiences so well, there is of course little 
reason to tamper with teaching. Or, if anything is to be altered, the pri- 
mary purpose in Arts and Sciences is to attract sufficient numbers of 
students in introductory courses in order to expand programs at the upper 
levels. Get them to enroll, provide a sufficiently entertaining and non- 
demanding experience to keep them there and water grading standards just 
enough to ward off a bad reputation. Besides, is not the true function of 
introductory courses from the department's view to discourage the unmotivated 
or unworthy from declaring a major in the field? 

The most disturbing thing about this congenial interpretation of 
student disabilities was that I had never really considered or tested the 
other possibility. Could it be that the majority of students did not 
recognize a challenge they wanted to meet? For the first time in my academic 
career, I wondered whether the claim of c^ertain scientists that anyone of 
ordinary intelligence could understand something of science might not apply 
to history also. This claim is born in part of a conviction that, unless 
the average citizen understand science or at least some of its implications, 
hope for a rational public politics is minimal. I hold an analogous opinion 
of the importance of history. I decided, therefore, to test the proposition 
that there might be a way to tap and enliven intellectual resources that had, 
heretofore, been well hidden. 

How did I come to rearrange the pieces of teaching method? The answer 
has three parts. Firsts I had to put aside all the traditional tools and 
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start from scratch. Second, I rethought objectives, about history, about 
courses, about student behavior. Third, I looked for a useable past. 

The obvious thing to put aside in the traditional method was the 
lecture. It certainly is fashionable to do so. But why? A reconsideration 
on my own terms was called for. The result was that I concluded that the 
lecture as dominant mode for the convey,3.nce of fact and of meaning is 
inefficient and, more disastrous still, At is largely ineffective. Most 
lectures I had as a student or delivered as a teacher were given over to 
conveying fact. It is patent that there are far more efficient means for 
relaying raw data to students. A mere repetition of the most important 
of them is a poor reinforcer and runs the risk of distorting history by 
reducing it to simplicities. Far too few lectures were effective in the 
sense that they defined a significant intellectual problem and resolved it 
insofar as the most pertinent facts admit of a solution. Few, In other 
words, transmit at a respectable level of intellectual difficulty the best 
of our cultural heritage from the perspective of the lecturer's discipline. 
Finally, even when lecturing is consis'iently exceptional in intellectual 
output, the question remains whether devoting ninety-^f ive percent of class- 
room time to lecturing is an educationally effective use of that time. 
Even when the lecture is integrating, does it force the student to a personal 
confrontation with history's unlimited possibilities? My argument here, as 
I hope to make clear a lit r,le later, is not with the lecture as such. Rather, 
it is wich its perversion In content and in place in the American public 
university. 

n»;ce having eliminated the lecture as predominant mode, the rest of 
the structure of my older courses fell of their own weight. The experience 
was painful and he\ ildering. But, what was most disorienting was considering 
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the alternatives. There seemed to be only two. The one, the notion 
that mass public education and quality in introductory courses at least 
were incompatible, I had already rejected as depressing conjecture. The 
other equally insistent suggestion of a public sort was that the answer 
lay in doing away with structure altogether. Create a decent human 
environment; forget about standards and content; let the student affectively 
establish his own terms of quality. That answer was no more tolerable than 
the first. For me, openness of style and relaxation of standards must not 
be compc^tible. Nor is the elimination of external motivation — coercion, 
if you will — acceptable. If the issue is only between learning as 
miserable work and learning as fun or, to put it in the current jargon, 
between the cognitive and the affective, content and process, I will 
abandon the latter without qualm. Fortunately, as student behavior in my 
courses over the last two quarters has indicated, the issue was neither 
so dramatic nor so necessary as that. 

The only way out of my dilemma was a fundamental reconsideration of 
what any course in history could possibly hope to achieve. Wbiat is teaching 
history all about? More important still, what can we expect of our students 
And, how can we communicate our expectations to them in a way that promotes 
a confrontation with history that is both challenging and exciting? 

When I began thinking through those questions the pieces of a new 
approach began to fit into place. The keystone was the realization that 
no course in history was or could be comprehensive. io insist that a 
working comprehension of the skeletal narrative of any iilice of history is 
the goal almost inevitably distorts the instructor's presentation and the 
studeat's perception of what history consists of. Moreover, it renders 
practically hopeless the task of getting the student to make judgements 
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about the significance of and relationships.' between disparate facts on 
his owTT.. At best then, the typical survey course reinforces the student's 
belief that history is somehow mysterious, knowable only to those more 
worthy intellectually than he. The implication of my reconsideration 
is not that narrative or the development of factual knowledge has to be 
abandoned, only that it can no longer serve as the goal of the course. 
That goal, instead, becomes developing skills for analyzing historical 
problems. And the student has to be provided with an opportunity to use 
and SO5 to refine, those skills. 

It also struck me that it is only fair to remind students that 
American history was lio more relevant to them, ultimately, than courses 
about the history of exotic places and ancient times. In other words, 
my course, like any other, is concerned with man as a problem solver in, 
essentially, a timeless moral context. Neither the student nor the teacher 
should expect the course to do more than suggest a few of the ways in 
which problems, having some sort of public dimension, 7;aised themselves 
for a given group of men at a given time and how men went about resolving 
or failing to resolve them. RelevanvCe^ in other words, is only a matter 
of personal identification. The student's task, at whatever level of 
intellectual sophistication, is to discover that identification. 

Having defined a more modest task for my course in terms of material 
to be covered in depth, yet having placed on the course a much greater 
burden in terms of transmitting meaning.^ I was free to take a new look at 
the older method. Clearly, that tradition offered much that was useful for 
restructuring pedagogy. 

Take, for instance » the lecture. For the first time, I was free to 
see its potential for the classroom. Thinking about the role of the 
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lecturer in the great universities, X discovered two conditions for 
employing it in public education, especially at the introductory level. 
First, the good lecture does not attempt to convey,-f act • It is interpreta- 
tive and integrative rather than narrative. As such, it is an excellent 
way to illustrate the process by y/a±ch. the historian confronts history. 
Like the historian's other professional work, the lecture is a form of 
argument — thematic in raising important problems and in resolving them* 
And, it communicates an intellectual attitude which actively honors the 
rational in man and affirms his claim to a worthwhile culture, 

The second condition is a recognition that in the great European and 
American universities the lecture is simply one of a number of resources 
for students • In those institutions, the classroom or lecture-hall is 
more incidental than central in the student's form.al education. He is 
free to take advantage of the best lecturers; he will not be damaged much 
by the vjorst. Few examinations that I know of in those settings are geared 
to what lecturers say or, more precisely, to how they say it. 

On these terms, I found that I could use the lectiire less frequently 
but more effectively in tha course. Each of the ten lectures I or guest, 
lecturers presented were now freed of the burden of sounding like a text- 
book chapter. Instead, they could be developed as a serious confrontation 
with a single or related set of historical problems and at a level appropria 
to the course taught. The students, for their part, were freed from the 
demoralizing responsibility of taking accurate notes on all that was said. 
They were free, if they chose, to become engaged with the lecturer in 
confronting history. At heart, then, the lecture became for me simply 
another resource ^or the student. And, he would take advantage of it only 
because he saw in it something of value. Stated another way, the expertise 



-236- 



of the instructor must be demonstrated, not presumed. 

Next I reconsidered the traditional seminar. It suggested the value 
of an open exchange of opinions and information among a limited number of 
students. Here was a testing ground for ideas. Further, the seminar 
Suggested that the student was c critical resource for discussion itself. 
He is motivated to study sources outside the seminar because of what is 
basically peer-group pressure and his corresponding desire to contributa 
Something to the group. At least within the peer group itself, a rough 
kind of equality exists. That is, the difference in sophistication and 
erudition between the brighter and less bright students is probably only 
marginal. Finally, by placing a premium on group projects, I hoped to 
enforce cooperative, if critical, rather than extreme anxiety-ridden 
relations among the members of each mini-seminar. 

Reconsidered in this way, a modified seminar form seemed ideally 
suited to forcing students continually to articulate their opinions 
about the history or historical problems they have studied. And, modi*^ 
fying the seminar a bit more by reducing my role within each group to 
ex officio status, one of the most severe educational handicaps facing 
many students in public higher education might also be overcome. Tor the 
first time, they would face equals, not supposed and intimidati'^ f; authorit 
in a discussion situation. Perhaps they would find that their own ideas 
had merit after all. More hopefully, they would discover that their whole 
ego did not ride on an idea that vas less tenable than someone else's. In 
short, they might realize that the merit of ideas Xvas not a function of 
personality but of learned, analytical and argumentative tools. And, to 
the extent that inequalities of talent do exist, it might be that some 
students would teach others and, in turn, reinforce their own educational 
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exper ience. 

Having defined new roles for the lecture and the seminar, and for 
students, I still needed a technique to make the thing go. What were 
students to do and how was I to evaluate what they accomplished? 

Tv7o other methods with equally venerable and useful histories provided 
the answer. The case study method has been used with tremendous success 
in professional schools and, certainly, has a secure place in the pedagc;g- 
^ical bag of historians. There is good reason for this success. The case 
study specifies a problem in detail, forces the student to play the role 
of decision-maker in a public way, forces him, moreover, to grapple with 
the X->roblem on its own terms and through primary sources. Secondary 
sources, including the expertise of the instructor, may be utilized; at 
best, however, they suggest only possibilities or ether modes of analysis, 
I opted for using the case study — indeed a number of them in order to 
dip into various periods of American history and, thus, highlight particu- 
larly thorny and persisizont problems endenr'c to our sociF.ty, 

The key to evaluating student perfor-r-;^o ^as suggested when I took a 
look at the lab, a scientist's equivalcr ■;. fc: the c:a39. study. Science 
teachers have a.nsisted, to the bewilderment of many in the humanities and 
social sciences, that it is absolutely necessary that students conduct 
experiments, that they dissect, combine, i-oun^e, luz^d in some way the 
subject under investigation* In other wordf^r the assumption underlying 
the lab — like the case study — is t'^/'t ::ud'..:7':.r ^ome to knowledge as 
they strip away m.ilspercsiptiions ar.d rrer. ::o -"oa:: is knowable by working 
directly with the substar^cc of the discApHre in systematic way. The 
lab director specifier? il/:. vvet^od of eyncirir^c^vy.^^ij ■ — the behavior 
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which wil.l lead the student to results that approximate reality. In the 
process, of course, the student develops rudimentary analytical techniques. 
The student's success in the lab can be evaluated rather easily in terms 
of the number of experiments he has conducted successfully and perceptively. 

The analog for an evaluative technique in history occurred to me. 
The student's success in the course is a function of his ability to suggest 
a solution to a problem in history which is literate (written with due 
regard for tlie rules of grammar), logical (conclusions follow from premises) 
and plausible (both premises and conclusions fit the facts). These three 
ideas., then, form a grading standard, one that, if it is not entirely purged 
of personal interpretation, does at least approximate objectivity. Moreover 
it is 'realistic. The student's task, in short, is to convince. 

Is the approach I have adopted valid? And, is it more effective in 
taping the intellectual resources of students and of more of them than 
/:he method I abandoned? The answers to these questions flraw on a variety 
of sources: word from the undergraduate librarian on the uncommonly high 
use of reserved material, personal impressions, verbal testimony of students 
and a complete record of course documents, including a lengthy course 
evaluation form. 

The general impression from all of this evidence is that the greater 
majority of students have found their confrontations with history challeng- 
ing, exciting and worthwhile. At least seventy-five percent of the 
thirty-three members in the first class and so far somewhat over sixty 
percent of the forty-six students this quarter have worked at a consistently 
high level of involvement and attainment. 
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With rare exceptions, the students began the course with an 
indifference toward or even a fear of history, the product of banal, 
boring or otherwise bad experience with the subject in the past. For 
them, to be excited by history was a personal revelation. And, not once 
does the evidence suggest that the work was easy or that the demands 
placed on them in terms of quantit^^ or quality were soft. Often the 
point is made in a log entry, sometimes in despair or condemnation, more 
often in a kind of glad astonishment, that never has the student worked 
so hard in a course. 

A typical example of the work students have been willing to do was 
the response of last quarter's class to the study exercises and fact 
skill exam. Both were packed into the first two weeks of the course rather 
than broken down into units. In other words, beginning with the first day 
of class and for five days running, students received a set of questions 
to work out overnight and to come to some resolution about in their groups 
the next day. At the end of that time an objective examination of some 
one hundred and ten questions was administered. Proficiency was demonstrated 
with a score of 70 or better. The personal logs covering this week or so 
present an amazingly consistent picture: of forty-six students, at least 
ninety per cent of them worked more than two and a half to three hours a 
night digging through the text. Only two students failed to attain a 
qualifying score of seventy on an exam of moderate difficulty. Out of 
110 points, seven students got marks in the '90 's, twenty-seven in the '80 's, 
ten in the *70*s and two in the '60 's. Few believed they could possibly 
"gut" a 500 page textbook; yet, the results of the examination seem to 
indicate that they did a fair job of doing just that. 
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Even more encouraging is the effective use of their groups nearly all 
the students have made both this and past quarters. Few indeed coasted on 
the work of others. Only four or five of the twenty-five groups so far 
have been unable to operate effectively on a consistent basis. Most students 
have found that the groups were a useful device for trading and testing 
ideas, seeing whether their answers W3re plausible. Quite a number discovered 
that when they found some questions particularly resistant, other group 
members had resolved them convincingly and vice versa . From my perspective, 
the sight and sound of students in an introductory course engaging one 
another in debate about the fine points of history warmed the soul and 
vindicated my faith in them. 

The experience with the case studies has been interesting and 
instructive. Work in class has usually been hard and conscientious. But 
a kind of cyclical pattern in enthusiasm and involvement established itself 
in the first quarter and has been consistent over the laj^t two quarters, in 
spite of variations in course design. Great excitement and interaction 
characterizes the wox'k of the groups for about three weeks. Then, a 
tendency toward drawing back and letting others pick up slack sets in, 
replaced finally by renewed enthusiasm toward the end. As a counter measure 
I have taken to setting aside a class period which is devoted to open 
discussion for the course and my hopes for it and for the students. The 
practice has a good effect, t^specially in reminding students about the 
objectives of a coarse in which they have the lion^s share of the harden 
for discovery. f 

Disappointment in the level of work exhibited in {a ^ number of case 
study papers last quarter, repeated again this term, led me to adopt a 
strategy quite in keeping with learning theory and, in fact, with common 
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graduate school practice. Interestingly, the finished products of the 
first quarter's class ^ with few exceptions, met my published standards for 
the grade of B — consisteiitly so from the second paper on. Yet, last 
quarter and this, many of the papers have not been that solid. Why the 
first class of randomly selected freshmen should have turr.3d in better 
papers than last quarter's sophomores and junior class or this quarter's 
freshman class is a bit of a mystery. At any rate, I began to turn back, 
with literary and substantive criticisms, papers I considered below honors 
level. This quarter, I made it clear in the syllabus that papers could be 
resubmitted as many times as a student wished without penalty. The last 
grade the paper received would be recorded. 

The result has been salutory. Papers have been worked up from the 
mediocre to the exceptional. Students have learned something about 
fashioning a public idea — literately, logically and plausibly. Knowing , 
that they need not fail, they have been resourceful^ energetic and often 
imaginative in defining, analyzing and resolving historic?.! problems. 

As I look back over student reactions and behavior; so far, a number 
of still random impressions stand out. For one, the relief that mine 
would not be a lecture course was nearly universal. (This was typically 
expressed before I bad presented my first lecture.) Closely allied to 
this feeling was the opinion, expressed in a non-coercive situation, that 
the case studies were much more valuable as a way of understanding the 
timelessness of man's decision-*making dilemmas than the standard lecture 
and secondary source approach. 

It Is iilso my impression that nearly all of these students can express 
themselves in writing fairly Tceil. That is, given the informal guidelines 
for the personal logs, sf.udents communicate effectively and, for the most 
part, with surprising grammatical facility. They use the vocabulary and 
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phraseolog^r they are comfortable with. They are direct. Host of the 
time, the}'' write in straightforward declarative sentences. The challenge 
I have is to figure out a transfer technique. That is, I must get them 
to resist the temptation to resort to an unfamiliar jargon and a highly 
stylized phraseology when it comes to writing formal papers. If the 
group papers are any measure, my constant reminders to them on this point 
may have some effect. 

Another impression is not nearly so random. It is, in fact, a 
conviction. The objectives sought in the course must be made perfectly 
clear to the student at the outset. If possible, something of tlic 
instructor's personal orientation toward material and pedagogy ought also 
to be spelled out. In other words, the student has a right to know 
precisely what is expected of him^ how he will know if he is or is not 
doing well and how he can improve his performance. The evaluation forms 
filled out by the first class are unanimous in their appreciation of the 
specificity with which my forty-page syllabus states objectives, course 
organization, grading standards?, and schedule and, further, states something 
of my own approach to history and its values. The syllabus does not tell 
them that the course is a breeze. Quite the contrary. The students all 
realize that they will work hard. What they do believe is that the course 
offers them an interesting opportunity to look at some aspects of history, 
to use their own intelligence and to succeed. The syllabus is my contract 
to them. On than basis, they'll sign up and work like hell, 

finally, let me try to anticipate possible points of critical inquiry. 
Isn^t my course only really catering to the current demand for the affective? 
Surely the affective plays a role in my classroom. But its utility can 
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easily be overlooked. I'Jhat the group method does foremost is to establish 
a behavioral reward system that is patently lacking in the passive lecture 
mode* It simply will not do to argue that students, by and large, lack 
motivation. Students are shrewder than we know. They conserve er-ergy in 
order to expend it on what they regard as rewarding experiences. Because 
we do not, in public institutions, have the run of highly S'elected students 
who are convinced already that the ^nost rewarding experiences are those of 
the mind, we have a far greater responsibility than Harvard professors for 
example to create exciting classroom environments. So far, my students 
have seen in the group approach, after soma initial scepticism, not a 
chance to hide again, but to work through some potentially interesting 
problems with others of similar skills. 

What is it then that I can certify about the students? Are they 
better people for having taken the course? I am not prepared, anymore 
than you are, to say that about my students. That is beyond my professional 
and personal competence. I only certify what I am able to observe in the 
classroom and am given, in my professional capacity, to evaluate. In that 
case, are the students better students as a result of the course? Do they 
know more about American history because they took my course rather than 
another? Frankness compels me to admit that I really don't know whether , 
six months or a year after the course, my students will retain any more 
of the facts of history than any other group of students. I would not be 
at all surprised, howev^^r, if they retained a fuller grasp of the factual 
setting of the five case studies. Still I do not regard that as much of a 
test, if only because, as an historian, I retain for ready recall only what 
I use year after year. However, to the extent that logs and evaluations are 
reliable, it appears that most of my students have developed an appreciation 
for history. And, I am persuaded that on the average my students will have 
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learned and retained many more of the techniques for investigating, 
analyzing and resolving historical problems than students trained in 
other surveys. Seventy-five percent of them will come out of my course 
with a fair start along the road of intelligent problem-solving. Now, 
that t'^ me is much more meaningful a measure of success. 

V^-iiich brings me back to my personal teaching credo. Let me restate 
it in the broadest possible terms,, thus returning to my opening premises. 
I think it is incumbent upon public higher education to provide educational 
opportunities on a grand scale — as grand indeed a5> is necessary to man 
this highly bureaucratized, technological society. Bring them in by the 
score. Then, let us do something creative with their experience. Let us 
introduce them to the excitement and challenges of the intellect. What is 
incumbent upon us, in other words, is to ensure that the quality of public 
higher education is not diluted. The easiest way to fail is to insist that 
the task is impossible or that only if we get motivated Students or only if 
we get more money can we do anythir^g. Do what? Reduce the student/teacher 
ratio from 30 to 1 to 15 to 1? Forget iti We are nrt about to enjoy that 
luxury again. The point is that V7e are not a high priesthood, guarding the 
sacred treasure of knowledge from the ravages of the uninitiated, but a 
service profession whose aim it is to direct our students to f.he challenges 
and rewards of intellectual experience. 

We cannot afford the luxury of reaching only the motivated thirty 
percent. For the most part, like students at thv. private schools, they do 
not really need us. Indeed, the Ivy League models are singularly inappro- 
priate to our responsibility. That obligation is to stimulate, goad or 
even trick the other seventy percent, who come to us already conditioned to 
think they have nothing to contribute. To get to them means we must be 
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willing to reexamine the nature of the classroom experience. It is, I 
submit, our success or failure to awaken the intellects of this truly 
hidden majority in our classrooms that will determine in a measure beyond 
our calculation the possibility for a rational public politics in the 
future . 
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OU TEACHING IN THE UNIVERSITY: A RESPONSE 
Carl Seiranelroth * 

Professor Buhl has raised a number of important and interesting issues 
concerning the goals of a University education, the learning process, and the 
implications of these things for the design of course instruction. In response 
to his paper I will address myself to two aspects of what he has said, and 
then, takin,5 advantage of the prerogatives of a respondent, I will initiate 
a small polemic of my own. First, I'd like to say a few things about why 
I believe the design of the History course which he describes is an excellent 
design. Second, I'll say why I think that he has done the right thing for 
the wrong reasons. That is, although I like the course he designed, I don't 
agree with what he says about it. 

First then, why is Professor Buhl's course design a good one? I propose 
the following criteria lor making that judgment. In order for a course to 
be a good one, the instructor should know something, i.e., ]ie should have 
something to teach. Although this prerequisite isi probably the most important 
single requirement for effective formal education, it is often considered 
frivoloui to talk about it seriously. The criteria of mastery of a subject 
matter area for purposes of teaching in thac area should be no less stringent 
uhan those criteria used for hiring a resecvrcher in that area. Also, just as 
individi^als vary in their degree of subject matter competence, different 
disciplines and areas within disciplines vary with respect to how mnch is 
known. Thus an instructor may fail to meat our first criterion for teaching 
an effective course either because he is poorly trained in the subject matter, 
or because the subject matter simply doesn't exist. In the present case, I 
think we can safely assume that American History since 1865 does exist, and 
that Harvard University effectively implanted that subject matter into the 
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repertoire of the instructur of History 112. I hesitate to give counter 
examples 'it the University for obvious reasons, but it doesn't seem to me to 
make sense to create a formal institution of learning, at great expense, and 
then offer courses in subject matter areas where the students are likely to 
know as much as the instructor. 

A second criterion for an effective course is to ask whether the students 
are told in a helpful way what they are expected to learn, and how they are 
expected to laarn it. Jim Bouton in his book, "Ball Four", had some rather 
succinct things to say about pitching coaches in major league baseball who's 
major teaching technique is to say 'ata boy baby" when you threw strikes 
and "you should never throw , that pitch in that situation" when he threw 
gopher balls. An exception was Johnny Sain who has a theory of pitching, 
tells his pitchers what it is and helps them experiment with it. Well, I 
would suggest that Professor Buhl is the Johnny Sain of History 112, Perhaps 
he will not produce an Early Wynn or a Denny >:cLain, but I suspect that his 
students find it a lot easier to learn history because he has told them what 
to learn and given them "do-able" tasks to help them learn it. Giving students 
"do-able" tasks from which they learn is probably the best way to describe 
the so-called new educational technology, e.g«, prograimned instrucf:ion. As 
Professor Buhl has demoni^Lirated in his history course, giving students 
"do-able" tasks does not require a "teacliing machine'*, nor must the tasks be 
ridiculously simple. They must be merely "do-able". 

Examples of tasks which are not "do--able" by students and from which iu 
is very difficult for them to learn are: ' "To prepare for a mid-term on 
Chapters 1-10 and everything in the first 5 weeks of lecture." or "To form 
a group and design a psychological experiment." In short, it's just a lot 
easier for students to learn something if we tell, them as well as we can 
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what they are expected to do in order to learn it. 

Another criterion for a well designed course is; Are the students told 
in a helpful way how their performance is to be evaluated? Professor Euhl 
has designed a rather ingenious grading system la which students are. "paid 
off" for the quality of products to which they contribute but where that 
pay-off is adjusted according to the quantity of their contribution to the 
product. This grading scheme is one which I suspect does a good job of 
informing the student about what is expected of him. 

My reaction, then, to the course design which he has described is that 
it is an excellent one because (1) it has a known subject matter, (2) the 
instructor knows this subject matter, (3) the students are tdld in a helpful 
way what they need to learn, (4) the students are given "do-able*' tasks 
which help them learn, and (5) the students are told in a helpful way how 
their performance is to be evaluated. 

4 

Now, my reaction to what he says about his course and about higher 
education in general. Professor Buhl has said that a meaningful measure of 
the success of his course is the number of students who leave the course having 
been trained better in intelligent problem solving. This criterion for success 
grows out of his statements of the value and function of higher education ~ 
namely, "the challenge is to educate more resourceful people, people who 

are skilled in problem-solving of a general sort and who above all, have 
have developed skills appropriate to understanding and affirming the best of 
our cultural heritage." 

I neither think that the goal of education is to train people in "a 
general sort" of problem solving, nor do I think Professor Buhl's course does 
this. Good education certainly does help people solve problems, but not 
because it teaches them problem solving, but because it teaches them information 
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e^xid skills necessary to the solution of problems. The cultural heritage, 
which Professor Buhl would like students to understand and affirm, consists 
in large measure, of a recognition that knowledge is good, that it is worth- 
while to le^rn. The reason it's good to know, rather than be ignorant, is 
that knowledge enables us to solve problems that we could not otherwise solve 
regardless of how clever we are or how good we are at "p^ot)lem-solving" in 
general. In short, I don't believe that Professor Buhl is teaching his 
students resourcefulness; however, I do believe that he is teaching them 
content which may very well be of use to them in the solution of problems 
they will face. 

Professor Buhl has a rather low opinion of lectures used to transmit 
information and the instructor as an authority which I don't share. I don't 
think there is anything intrinsic about lecturing, as a method of teaching, 
which makt:S it a poor way to transmit information. I experienced a lot of 
poor teaching, both lecturing and otherwise as a student just as he did, but 
the lectures were poor because the instructor didn't bother to tell us what 
we were expected to learn from him, or what questions he was answering. I 
also experienced good lecture courses, which did transmit information. In 
fact, probably the best undergraduate instructor that I had taught statistics 
by lecturing. Of course, he didn't teach statistics very long; they made 
him an Assistant Dean. 

As for the instructor as an authority, the term "authority" has several 
definitions. One is "the right to control, command, or determine." Another 
can be transmitted without authorities in the sense that they are "accepted 
sources of information." Surely we cannot expect every student to research 
again all physics and chemistry or, perhaps more to the p^xnt, historical 
er/enCs. Thus it would seem that the instructor should be an authority in the 
sense that the student can depend on .him as a source of information. 



-250- 



ERIC 



As for the instructor as an authority in the sen^e of having the right 
to control, I suspect that Professor Buhl controls the behavior of the students 
in his history course quite effectively. In fact he has told us that his 
grading system and log book requirements were consciously designed to produce 
particular student behaviors. Perhaps his objection, then, is to the instructor 
as a punishing authority, in which case I agree. There are many problems with 
the use of punishment as a method of regulating or controlling behavior aside 
from jv.st ethical considerations. Its biggest problem is that the use of 
punishment: makes avoidance behaviors reinforcing. Unfortunately, or fortunately, 
depending on your point of view, the student has other ways to avoid punishment 
in a course aside from the behavior of learning, for example, cheating, not 
going to class, dropping the class or dropping out of school. But the solution 
is not to stop trying to control the students' learning, but rather to control 
it better. One way of doing this is to design courses where the student can 
be reinforced for learning rather than punished for not learning and I think 
Professor Buhl has done this. 

And now my polemic. What is needed to .improve the quality of instruction 
in the University is not so much the application of new methods of instruction 
or innovative teaching. Rather we need innovative methods in the care and 
feeding of instructors. I would maintain that the necessary ingredients of 
good instruction are obvious to any professor who sits down and tries to 
design a course. There is probably no professor at this University who 
doesn't agree that It's more effective to tell students what they are expected 
to learn than it is to throw a lot of material at the students and then 
reward the students who learned certain parts of the material and punish 
those who didn't. And yet, many, if not most, of the courses which I exper- 
ienced as an undergraduate, and I suspect many of the courses at this univer- 
sity, were nothing more than a reading list and a set of exams. This doesn't 
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mean that I didn't learn anything. But, we don't need most of the faculty 
and most of the physical plant of the university in order to educate students 
in this manner. All we need is the library and a set of exams over various 
subject matter areas. 

If it is true, as I have maintained, that the ingredients of good course 
design are quite simple and in fact are well known to all instructors, then 
the question arises: T^y aren't the courses uniformly much better? 

I think there are several possible answers to this question. Let me 
illustrate by giving you an only sliglitly apocryphal case history. 

Mr. Jones, who was in the latter stages of his Ph.D. training, was 
given a teaching fellowship which involved total responsibility for a course 
in his area of interest. Because he intended to join the academy after 
graduatioi , and make his living teaching, he was particularly excited about 
this opportunity. Mr. Jones had also given some thought to why he had been 
less than satisfied with many of his university courses and was determined 
to do better. He had learned to get good grades in school, and at the same 
learn something, however, it seemed to him that much of the effort required 
to get good grades had very little to do with learning. Much of it was spent 
on outguessing his professors and fellow students. He had been around long 
enough to suspect that one of the reasons why he had to guess vhat to study 
and learn for exams was that many of his instructors didn't know what they 
were going to put on the exams until t::c d^yc ^^.fore the exams. He was 
determined to avoid this and other problems so that his students could devote 
their energies entirely to learning course material rather than coursemanship . 
He had some time during the summer to think about the design of his course 
and a series of exam quei^tions covering the material he wanted the students 
to learn. Come September, he opened his first class by handing out his 
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carefully written syllabus containing course objectives and* series of exam 
questions and told his students that he was there to help them learn the 
material. Things went well for the first week or so; the students were 
> attentive, they came to class, they asked relevant questions and Mr. Jones 

really felt like a college professor. He gave the first axam and the results 
were phenomenally good. Thirty.-five of his forty students had received 90% 
or better. As the quarter went on he continued to get good exam papers but 
he began to feel a little uncomfortable. First he began to worry about 
grades. His tests just weren't discriminating very well among the students. 
Furthermore, his students weren't acting very attentive in class. Their 
questions were still relevant; that wasn't the problem. It was just that 
they didn't look like they were paying attention and furthermore attendance 
wasn^t very good. In short, the students had stopped behaving toward him as 
if h^* were a professor. The biggest problem he had was that he could see that 
they were going much faster than he expected and he would have to add some more 
material to the course, 'le decided to add ,a required lerm paper - The day he 
announced the paper and described the various options involved with it was 
the best he'd had in several weeks. The students perked up, looked attentive, 
several came up af ten/ard and talked and he again felt like a professor. The 
papers turned out to be quite uneven in quality and his grading problem was 
solved. Furthermore, he found that when he talked to other teaching fellows 
about some of the lousy papers his students had xirritten they seemed interested 
and told him about some of their own experiences whereas earlier when he had 
attempted to tell them about how well his class was doing, they didn't seem 
much interested. 

The following quarter Mr. Jones was given another course to teach. He 
Q didn't have very much ?;ime to prepare for it, so he was forced to prepare 
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time what was going to be on the exams, but he found this to be a difficult 
task week by week. He became increasingly reluctant to tell his students 
what his hastily prepared questions were because the students seemed to be 
looking for a rote answer to memorize and put on the exams. He therefore 
adopted the technique of talking in general about what was to be on exams. 
This seemed to work better and furthermore attendance and student interest 
went up dramatically. Three years later Dr. Jones is an assistant professor 
at a large mid-western university. He teaches principally by lecturing with 
a required text, a mid-term and a final exam plus two short papers. He has 
a student, a Mr. Smith, who is thinking about going to graduate school and 
becoming a college professor because he is quite dissatisfied with the amount 
of effort he must spend out-guessing his instructors and other students to 
get good grades and he thinks he could do much better than Professor Jones, 

My point is that the problem of improving instruction in the university 
is not one of finding innovative teaching methods. The problem is to find 
innovative methods of making the use of effective teaching methods desirable 
and rewarding for ourselves so that we will use the methods already available. 

In summary, although I don't agree with everything Professor Buhl has 
said about the goals and methods of teaching, I do think that the History 
course which he has designed takes into account very well the ingredients 
needed for effective teaching. However, I suggest that the major challenge 
is to make whatever changes are necessary so that the consequences to our- 
selves for effective teaching methods are more desirable than the consequences 
for the use of ineffective teaching methods. If we can do that, someone else 
will not need to do it for us. 
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A SYSTEMATIC APPROACH TO TEACHING SECONDARY UNDERGRADUATE METHODS 

Robert H. MacNaughton * 
Richard J. McArdle + 

A new College of Education in a new university seems the proper place 
for an innovative approach to the perennial problems that surround the pre- 
service, secondary methods course offerings. The problems are legion* Some 
of the more frequently articulated include: the criticism that theory is 
.separate from the real world of the seondary school; the criticism that 
there is an instructional emphasis on unsupported generalization rather than 
development of specific skills and competencies; alienation of liberal arts 
faculty in course planning; and failure to adequately involve secondary 
school teachers in planning for the related field experience portion of these 
courses. With these in mind, and after numerous conferences among College of 
Education faculty, liberal arts college chairmen and public school personnel, 
a new course. Education EDS 300, Curriculum and Methods, was launched. 

The new course brings together those concerned with what to teach and 
those concerned with how to teach, in an attempt to produce a better pre- 
pared teacher. It tries to do this in part in the real atmosphere of the 
public school classroom with the assistance of an experienced teacher. 

The basic principles guiding the new course are as follows: 

That preparation of teachers should be a teaiti effort involving 
academic specialists, experts in classroom procedures, and 
classroom teachers in the field. 

That performance criteria for the methods students should be 
established and that a systematic design be drawn to enable the 
students to attain these criteria. 
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In keeping with .these principles, the following course objectives 
were established to enable the prospective teacher: 

1. To develop an appropriate concept of his discipline. 

2. To select what should be taught in his area of specialization 
and develop a rationale for this, 

3. To select and state behaviorally appropriate instructional 
objectives to give direction to his teaching. 

4. To systematically plan procedures for carrying out his stated 
objectives, 

5. T") practice various teaching strategies. 

6. To develop and test out a theoretical base for maintaining 
the learning environment. 

7. To analyse, the verbal and non-verbal aspects of the teaching 
act in general and apply this analysis to his own teaching 
behavior. 

8. To identify and explain specific, recent innovations in 
education. 

9. To practice implementing specific instructional objectives. 
In order to implement these objectives, each one was analyzed, 

breaking it into "tasks" which <:he student needed to accomplish. For 

each task, learning activities x-zere identified which were needed to 

provi*de the required skill, knowledge, etc., to accomplish the task. 

Finally, a performance standard was chosen which would indicate that 

the student had successfully completed the objectives. 

The following is sxi example of breaking an objective into tasks, 

teaming activities, and performance standards. 

Objective //3 - To select and state behaviorally appropriate 
instructional objectives to give direction to 
his teaching. 
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Items "A" through "E" illustrate the tasks to accomplish Objective 



The learner must be able to distinguish between broad 
educational objectives and Instructional objectives. 

The learner must be able to distinguish between instructional 
objectives which are behaviorally stated and those that are 
not. 

The learner must be able to identify the domain of a given 
objective as belonging to the lowest or higher than lowest 
level of cognition. 

The learner must be able to classify cognitive objectives as 
belonging to the lowest or higher than lowest level of 
cognition. 

The learner must be able to write objectives in each of the 
three domains and indicate the level of the cognitive 
objectives . 

Some learning activities for tasks A-E include: 

Reading programmed text on behavioral objectives, viewing 
film strips on behavioral objectives (optional) , participating 
in small and large group discussions, and conferring v7ith 
instructors . 

.* 

The performance standard consists of a three-part written test in 
which the student must identify a list of 20 objectives as behavioral or 
not (minimal: 18 right); identify the primary domains of 10 objectives 
(minimal: 9 right); identify level of 10 cognitive objectives, indicating 
whether the objective is of the lowest level or higher than lowest 
(minimal: 10 right). 
Course Components and Scheduling 

In order to achieve the objectives, the course is divided into 
four basic components, two theory and two practice-centered. In one of 
the theoretical components, students are grouped without regard to 
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their area of academic concentration. This component " emphasizes the 
pedagogical, such as stating objectives ^ planning lessons, analyzing 
teaching, managing the classroom, etc. 
^ The second theoretical component concentrates on the student *s 

specialty and emphasizes content. A subject matter; specialist from the 
College o'f Education, a representative of the appropriate academic 
department, or possibly both, usually conduct this component. 

The two practice-centered components are divided between actual 
field experie-nce in selected schools and simulated laboratory experience 
on campus. Tlie field experience consists of regular, specified group 
experiences, each with a specific performance objective developed 
cooperatively between the University and representatives from the schools 
involved. 

Some examples of these field experience objectives are as follows. 
The student will: 

* 

(1) describe the school conmiunity and indicate the impact on 
the school program. 

(2) identify a variety of teaching techniques and teacher 
behaviors and observe as many examples of these as possible • 

(3) identify and evaluate various means of attaining effective 
classroom control and management routines. 

(A) anal3^ze and evaluate the role expectation of a teacher in a 
classroom and in the tctr^l school hcreaucracy. 

(5) practice establishing Instructional objectives, assess the 
readiness of leatn^rs to attain these objectives, and plan 
to teach a lesson to an individual or group of learners 
to attain these objectives. 

The simulated laboratory experience consists of many activities, 

such as micro-teaching, programming, simulation gaming, tutoring, etc, 

ERIC 
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Various time arrangements have been trie<^ for this course, but a\t 
present students register for eight quarter hours of credit, blocking out 
two hours every morning for the ten-week quarter. The ten weeks are 
divided into blocks of time for each of the components. The theoretical 
components are divided equally between pedagogical and conCent^oriented 
methods. The practical components consist of two weeks of concentrated 
experiences in a cooperative school and four weeks of simulated laboratory 
experiences on campus. 
Effects 

Judged by the standard of the degree to which students who take 
Curriculum and Methods can mee?: the performance crit eria, the course 

has been successful. A majority of the students can state objectives 

j 

behaviorally , can play systematically for their attainment, and can meet 
the other performance standards. In addition, every student has an 
opportunity to rate the course*., and the tabulations over the quarter 
are generally positive. The real issue, however, is the extent to which 
the course objectives produce students who possess competencies which 
will enable them, as secondary classroom teachers, to facilitate their 
pupils* learning. On this much evidence is still out. However, the 
results to date have led to a desire on the part of the faculty in the 
Department of Secondary Education to further revise the undergraduate 
professional curriculum. For the past year a committee has been studying 
the problem x^ith the resulting recommendations: to enlarge the time 
block for the course by merging the Evaluation and Measurement course, 
triple the field experience time, provide for various alternatives 
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(programming, gaming, open classroom, etc.)> and further individualize 

instruction through development of learning packets. 

Conclusion 

The course has not been without its problems. Chief among them 
has been the coordination of syllabi and continuously changing time and 
space allotments. True coordination requires that faculty members 
communicate .within and across departmental and institutional lines. It 
has not been easy, and placing the entire curriculum in such an arrangement 
will certainly increase the problem. The faculty has, however, committed 
itself to this direction; and it is not likely that it would be satisfied 
to return to the old arrangements, even if at times it seems the simplest 
thing, to do. Continuing favorable reports from student questionnaires, 
as well as favorable reports on student teachers in the field, help to 
support the conviction that we are moving in the right direction. 
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A SYSTEM FOR PROGRA'MMING INSTRUCTIONAL DIALOGUES ON A SMALL COMPUTER 

Phillip L. Emerson * 

A syste.\i> is in operation whereby a teacher may compose a sequence 
of lessons to be stored on computer tape and administered automatically 
to a student via a teletype terminal. The system is highly flexible in 
that the capacity for branching and cycling within a lesson sequence, 
depending on the student's responses, is almost unlimited. Also, the 
lesson author is provided with almost the full capacity of a powerful 
text manipulat:.^on language, SNOBOL, for making transformations and tests 
on the student's responses. An additional important feature is that the 
lesson author may provide a glossary of information which the system 
then uses to answer cuestions that the student may ask during a lesson^ 
The system can accommodate variations in the style of lesson composition 
to take the best advantage of the particular combination of memory size 
and mass storage device. 

. INTRODUCTION 

We describe here the main functions of a set of programs for writing 
and automatically executing a sequence of dialogues or lessons. Such a 
system could probably be implemented on many of the various models of 
mixiicomputers (Sidowski, 1971) which are now available. However, some 
form of mass storage device, interfaced to the computer, is an essential 
part of the hardware system. The style of the lesson programming examples 
.jo.re tends to reflect our hardware configuration, which is an 8K PDP-9 
with three DEC tape drives, but variations of style are discussed that 
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would be appropriate for systems with more or less core memory, and 
x^ith other mass storage devices such as disk or drum. 

The fundamentals of the course author language are explicated and 
exemplified in order to convey a taste of its flexibility and simplicity. 
It is founded on the SNOBOL language, and particularly on an early version 
(Farber, et al., 1964). Although there are now later versions (Farber, 
et al., 1966; Forte, 1967; Griswold, et al., 1968), the earlier one was 
most feasible for a small computer. 

ORGANIZATION OF A LESSON SEQUEl^CE 

A course of instruction consists of a sequence of lessons which 
are written into files on the mass storage device by means of the normal 
alphanumeric source program input device, a teletype in our case. The 
number of lessons in a course and the lengths of the lessons are variable 
according to the subject matter and the* parl:icular objectives of the 
sequence. A lesson is divided into a sequence of sections, each ssection 
consisting of a sequence of lines on a teletype. The length of a section 
is the main stylistic variable whereby the best advantage may be taken of 
the particular hardware system. During the execution of a sequence, a 
single section resides in core memory at any given time. Thus, conditional 
branching and cycling within a section may be done freely. Branching and 
cycling between sections are also possible, but they involve searching 
through the lesson file on the mass storage device, which may mean 
significant delays in execution unless the device is a disk or a drum. 
In addition to the lesson files, the course author may optionally provide 
a glossary file containing terms, definitions, explanations, examples. 
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and the like, to be used in response to questions from the student 
during the execution of a lesson. 

The Lesson Tile . The largest self-cont-rd.ned unit is a lesson 
whose length is usually determined by constraints on the duration of a 
student session, and convenient divisions of the subject matter. 

The Glossary File Name . The first line in the lesson file contains 
only the name of the glossary file to be used in answering questions. 
Till,:: name should be started at the left margin. If the author chooses 
r^ot to provide a. glossary, this line is necessary anyway, and a dummy 
name should be supplied. 

Section Numbers . The sections in the lesson file are separated 
by section numbers prefixed by the number sign, //, on the left margin. 
The Sections should be numbered in increasing order, but not necessarily 
consecutively. We usually start by using the sequence of section 
numbers, #5, ^'/lO, //15, etc., so that gaps are left for the possible 
insertion of new sections if the lesson is edited later. Nothing 
else should appear on the same line with a section number. After the 
last section in a lesson, an additional dummy section number should be 
included as the last line in the file. 

Section Lines ^ The executable part of the lesson consists of 
the sequences of lines within sections. These lines are for the most 
part statements in the SNOBOL language. 

SNOBOL is a language for the storage, retrieval, and manipulation 
of strings of alphanumeric characters. A SNOBOL statement consists of 



ERIC 



-263- 

three parts: (1) A label , (2) a rule , (3) a goto . The rule is the 
executable part whereby string manipulations ara performed and tests 
are made. Tile goto provides a way of conditionally branching out of 
the normal sequence of execution vhich is the sequence in which the 
statement, are written.. The label of a statement acts as its address 
which may be specified as the destination of a branch via the goto 
of some othei statement. 

In Sl'JOBOL rules, strings of characters may be created, stored, 
retrieved, manipulated, and tested. Storai:;e and retrieval ordinarily 
are performed by the use of string names. The other operations m?3y 
involve reference to strings by their names, or by the specification of 
the literal contents of strings. Rules may be classified by the 
operations perfoirmed.j and there are three main kinds. They are: (1) 
formation rules, (2) pattern matching rules, and (3) replacement rules. 
The formation rule simply creates a strong with a specified name, giving 
it specified contents. 
An example is 

X « '1^3' 

This rule when executed forms a string named X with the contents, 123. 
Apostrophes are used to specify the literal contents of a string. The 
string named X will now contain 123 until some other rule is executed 
giving X some different contents. Thus, a formation rule defines a 
string name and also implicitly performs a storage operation. The contents 
of X can be retrieved and examined later merely by mentioning the name 
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X in a SNOBOL rule. 

The pattern matching rule provides a way of examining the contents 
of a named string, and making tests thereon. It formally resembles a 
formation rule, but without the equals sign. An example is 

X '23' 

This rule causes the contents of X tc be scanned for an occurrence of 
the substring, 23, A pattern matching rule is said to succeed or fail 
according to whether or not an occurrence of the specified pattern 
was found on the scanned string. The above rule would succeed if X 
were previously defined by the formation rule above, since the string, 
/i23^ concains the substring, 23. The success or failure of a pattern 
matching rule can be used for conditional branching by means of the goto 
of the statement as indicated below, 

The replacement rule combines the pattern matching rule and the 
formation rule to permit the scanning of a string for a specified 
pattern and the substitution of something else for the pattern in the 
second string, all in one operation. For example, 

X ^'23^ » '4* 

causes the contents of the string named X to be scanned for an occurrence 
of the substring, 23. If successful, the string, 4, would be substituted 
^'or 23. For X initially having the contents, 123, the result of the 
execution of this replacement rule would be that X ;TOuld now have the 
contents, 14 • 

These three kinds of rules provide a flexible and powerful basis 
for all kinds of string operations. Other features of SNOBOL significantly 
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augment this power and flexibility, notably, string variables, arithtnetic, 
and indirect referencing (Farber, et al., 1964). However, we may 
proceed to see how labels, rules and gotos are combined into statements. 

The label is the first part of the statement, rhe rule the 
second, and the goto the third. The label is some string of 
alphanumeric characters. It should be typed starting at the left margin. 
The label is optional if there is to be no transfer to the statement 
from some statement o^ther than the immediately preceding one. If a 
statement has no label it should begin with a space or tab. 

The label, rule, and goto are on the same line, separated by spaces 
or tabs. The goto begins with a slash, and the remaining part takes a 
form depending o- the desii-ed conditions of branching. The unconditional 
goto consists of a slash followed by a -;et of parentheses enclosing 
a specification of the label of the ststmenf. to be executed next. 
For example, 

/(3) /(7) /(START) 

are unconditional gotos. A conditional goto is similar, but' either the 
symbol S or F occurs before the leading parenthesis to specify a 
transfer only on success or failure, respectively, of the pattern match 
in the rule of the statement. Both cases may be specified. For 
example, 

/F(3) /S(7) /F(7)S(START) 

are conditional gotos, A simple application of these features is in 
writing a statement to substitute spaces for hyphens on the string 
named LINE. 

SUBS LINE ' » = ' ' /S(SUBS) 
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The statement lab£?l is SUBS. The rule causes the contents of LINE to 
be scanned for an occurrence of a hyphen. If one is found, a space 
(specified by the space between the two apostrophes to the right of the 
equals sign) is substituted for it and the rule succeeds. In that 
case, control transfers to the same statement: be executed again. 
This goes on until there are no more hyphens in the contents of LINE, 
and control then passes to the next statei^ent in the program. Lines 
beginning with an asterisk are comments. They are ignored in 
execution and are useful only for the humans who read the program 
listing. 

The course author language is based on SNOBOL but it has some 
other features that are not part of SNOBOL. The input and output 
commands, for example are not of the conventional S^^OBOL kind. To 
have ^'THE QUICK BROI^I FOX'* typed on the teletype, the course author 
uses the special symbol, T;, in a rule in the following way 

T: 'THE QUICK BROIJN FOX' 
To rcvad a student's response from the keyboard into the special 
string, R: , the special symbol, S:, is used in a statement as illustrated 
in the examples below. 

Aside from these differences, the other main one is that the 
statement labels are restricted to numerical positive integers. A 
transfer may be made via a goto to any numbered statement only in the 
current section, but to any different sect;ion (to the first statement 
in it) by using the number sign and section number in the goto. Also, 
there are some special system routines that may be transferred to by 
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placing their names in a goto. They will be illustrated below. 

Most of the features are illustrated in the following short section 
in a lesson 



2 
3 

/M5 



'mER DID BEKESY WIN A NOBEL PRIZE?' 

" /S(ASK) 
'1961' /F(3) 

'THAT IS CORRECT.' /(NEXT) 
'NINETEEN SIXTY ONE' /S(2) 
'IN WHAT YEAR?' /(I) 



Putting NEXT into a goto as in line number 2 above, causes a 
transfer to the next section which would be //45 in this case. Line nuiiiber 
1 causes a line to be read from the keyboard into the string, R:. The 
line after line number 1 is a test of whether or not the response ends 
\d.th a question mark. If so, control is transferred to the system routine, 
ASK, which looks in the glossary file for an entry term identical to the 
part of the response preceding the question mark. 
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This example does not illustrate particularly good programming 
practice* It treats as correct any string containing '^1961" or "nineteen 
sixty one" as a substring, which clearly includes such response as "not 
in 1961", etc. The tests on the response string can be made more exten- 
sive to test Tor a number of likely paraphrases of the correct answer, 
and to test for various incorrect answers with appropriate guidance 
toward a correct answer. Some improvements are made in the following 
revision of the section in the above example. 



//AO 





TRY 


= 






T: 


'WHEN DID BEKESY WIN A NOBEL 


, PRIZE?' 


1 


S: 








R: 


" /S(ASK) 




2 


- R: ' 


J = ' ' /S(2) 




3 


R: ' 


' = ' ' /S(3) 






R: 


'NOT' /F(4) 






T: 


'PLEASE ANSWER AS SIMPLY AS 


POSSIBLE. ' 


4 


R: 


'1961' /F(5) 




6 


T: 


'CORRECT!' / (NEXT) 




5 


R: 


'NINETEEN SIXTY ONE' /S(6) 






R: 


'NINETEEN HUNDRED AND SIXTY 


ONE' /S(6) 




R: 


'NINETEEN HUNDRED SLXTY ONE' 


/S(6) 




TRY 


'1' /F(8) 
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T : 'IN miAT YEAR? ' 
TRY = '2' /(I) 

8 T: 'IN 1961 BEKESY WON TlIE NOBEL PRIZE' 
T: 'IN PHYSIOLOGY AJID >!EDICINE. ' /(NEXT) 

i?45 



Here the same question is asked, but lines 2 and 3 reduce the response 
to a more standard form by substituting spaces for hyphens and single 
spaces for multiple spaces. The line after 3 tests for negation, and 
the student is asked to rephrase his ansvrer if it contained the word, 
"not''. Lines 4, 5, and the three following 3 tost for five variants 

t 

of the correct answer. Then a test is made for vThether or not the 

present incorrect answer is the first or second one given. If it is 

the first, the student is prompted, ''in what year?** and given another 

chance to answer* If he is wrong a second time, the transfer is to 

line 8, where he is given the correct answer, /another improvement 

could be made by changing the goto, /(:TEXT), in line 6, to /(-!!50)y 

and then writing in section i^^5 the same question in a slightly different 

form. Thus, #45 would be skipped if the student gave the correct 

answer in The tests for variant forms of the correct answer at 

line 5 and the two following lines could be made more easily, essentially " 

in a single statement, by the use of string variables, a feature of 

SNOBOL that we have not discussed here. 
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The system reads a full section into core memory from the mass 
storage" device, and then executes it. It then reads in another section, 
overlaying the last, and .^'.ecutes if. The program lines of the preceding 
section are lost when overlayed, but the Cx ntents of any strings defined 
by the execution of the preceding section are not. Thus, in the last 
example above, Xne :>trings, TRY and R: would still have the contents 
last given them in it%Oy after transfer to the next section. The string 
preservation feature permits a mi ^-e or less* connected dialogue to extend 
over several sections even though the amount of core memory available 
limits the lengths of the sections. This feature, together with the 
capability of branching out of the section sequence, is the basis of 
a capacity for a tradeoff between core memory size and the speed of the 
mass storage device, to maximize the efficiency of execution. 

The Last Section in a Lesson. The last section may inform the 
student that the lesson is ended, congratulate him for finishing, and 
inform him as to the file name and general subject matter of the next 
lesson. It may also suggest something for him to read before starting 
the next lesson. 

The Glossary File. The transfer to ASK, as seen in the gotos of 
the examples above, actually causes a transfer to a system routine 
which searches through the glossary file provided by the author. The 
same glossary might be used for a whole course of lessons, but an 
interesting option is to use a different glossary for each lesson in a 
sequence, where the successive glossaries become more refined or 
technical. They might be made to correspond to a sequence of models of 
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the student^ s cognitive structure of the subject matter as he progresses 
through the lessons. For example, in a course on statistics starting 
at an elementary level, the entry for ^'distribution" for an early lessoa 
might simply describe and give an example of a frequency distribution. 
For a later lesson, the same term might be J:he key to an entry which 
classifies distribution as empirical frequency distributions and 
theoretical probability distributions, defining several common forms, 
of the latter. 

The structure of the glossary file is as follows. It consists of 
a sequence of entries , each consisting of one or more lines, with 
successive entries separated by a line containing nothing but an 
asterisk on the left margin. In general, an entry consists of a term 
foflowed by a colon, followed by the body . The term is the lexical 
key to the entry, i.e., the part that the system attempts to match 
with the significant part of the student's query (the query term). 
There are two kinds of entries , direct and indirect. The indirect 
entry is distinguished by the fact that the first part of its body is 
the string, "SEE", which is then followed by the referent term which 
is a term for some other entry called the "referent". An indirect 
entry consists of only one line. The body of a direct entry may occupy 
the remainder of the first line and usually several r.ore lines of text 
defining the term, giving examples, etc. The only strict requirement 
on the order of the entries in the glossary file is ^.hat indirect entries 
must precede their referents. This is necessary because the system searches 
from beginning to end starting vjith a query term. \*Jhen it encounters 
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an indirect entry whose term mtches tbs query term, it replaces the 
query term with the referent term and continues the search, etc, , until 
either a direct entry cerm is matched or the end of the file is reached. 
If a direct entry term is not matched, that whole entry is displayed 
to the student. If not, an appropriate message is printed. In either 
case, control is then passed back to the beginning of the section in 
which the student's query occurred. A brief example of part of a glossary 
file is as follows : 

FREQUENCY DISTRIBUTION: SEE DISTRIBUTION 

PROBABILITY DISTRIBUTION: SEE ^JXSTRIBUTION 
* 

RELATIVE TREQUENCY DISTRIBUTION: SEE DISTRIBUTION 
* 

DISTRIBUTIOl^: THREE KINDS OF DISTRIBUTIONS ARE: FREQUENCY, PROBABILITY, 
AI^D RELATIVE FREQUENCY DISTRIBUTIONS. FREQUENCY DISTRIBUTIONS ARE 
EMPIRICAL DISTRIBUTIONS FORMED BY SETTING UP A SET OF MUTUALLY EXCLUSIVE 
AND EXHAUSTIVE CATEGORIES ON SOME VARIABLE, AND THEN COUNTING THE ITUMBER 
OF OBSERVATIONS FROM SOME FINITE SAMPLE, FAI.LING WITHIN EAOT OF THE 
CATEGORIES. A RELATIVE FREQUENCY DISTRIBUTION ir> DERIVABLE FROM A 
FREQUENCY DISTRIBUTION BY DIVIDING EACH CivTEGORY FREQUENCY BY THE TOTAL 
NUMBER OF OBSERVATIONS. PROBABILITY DISTRIBUTIONS ARE MUCH LIKE RELATIVE 
FREQUENCY DISTRIBUTIONS, BUT V/ITH EMPIRICAL RELATIVE FREQUENCIES REPLACED 
BY PROBABILITIES DERIVED USUALLY FROM TUEORETICAL ASSUMPTIONS ABOUT 
THE RAl^IDOM PROCESS. SEE PROBABILITY. 

Here, there are three indirect entries all referring to a single 
direct entry. Note that "SEE PROBABILITY" ar the end of the DISTRIBUTION 
entry is merely a part of the text to be displayed, and does not function 
as an indirect reference, since the "SEE" does not immediately follow the 
first colon on the first line of the entry. It merely suggests to the 
student that more relevant information might be obtained by a query about 
probability. Presumably, the glossary file contains such an entry. 
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Since the glossary search depends on an exact characterx-^ise match 
of the contents of R: to an entry term, it may be wise to preprocess 
the conten'>:t of R: a little before transferring to the system routine, 
ASK. For example y it might help to substitute spaces for tabs, to 
remove extra spaces, and to remove pur^cfuation such as periods and quotation 
m^irks. Such operations are easil^^ programmed in a few extra SNOBOL 
staiiements. But even with this kind of editing, the format of the query 
is quite restricted. 

It is possible to carry the preprocessing to higher levels, removing 
insignificant phrases such as *'what is," "what are," and "what does 

mean;" For extensive preprocessing of queries, the 

lesson may contain a set of special sections for that purpose, which are 
transferred to only when the student asks a question. However, it is' 
rarely worthwhile to try to- carry the preprocessing to very high levels. 
The linguistic competence of the student to edit and transform his 
question usually is far greater than that provided by any small set of 
computer instructions. 

CONCLUSION 

By nox7 there are quite a few computer progr^ins and systems designed 
specifically to facilitate the composition of lessons to be administered 
by a computer. Zinn (1969) and Frye (1969) included about thirty different 
ones in their comparative reviews. In some cases, they found little 
basis for comparison, due to the heterogeneity of objectives. The present 
system, regarded simply fis an abstract coursewriter language, probably 
does not really excel on any of the common criteria of comparison. Its 
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main distinction is that it is designed for and is being used on a 
computer without a great deal of core memory. With due credit for 
this handicap it probably would compare favorably with most other 
systems. The present system trades a little intuitiveness to gain 
much freedom for the course auti:or to simT'Tate the real-time decision 
process of a sensitive tutor* The "ugly*' aspect is that the course 
author must think at the level of character strings, but this level of 
analysis may be natural for some instmctioual subjects such as computer 
programming r 



-275- 



REFERENCES 



Farber, D. J., Griswold, R, E, and Polonsky, I. P. "SNOBOL, A String 
Manipulation Language", Journal of the Association for Computing Machin<ary » 
1964, 11, pp. 21-30. 

Farber, D. J., Griswold, R. E. and Polonsky, I. P. "The SN0B0L3 Programming 
Language", Lell System Technical Journal , 1966, 45, pp. 895-944. 

Force, A. SN0B0L3 Primer , Cambridge, Massachusetts Institute of Technology 
Press, 1967. 

Frye, C. H. "CAI Languages: Their Capabilities and Applications", In 
Atkinson, R. C, and Wilson, H. A. (Eds.), Computer Assented Instruction; 
A Book of Readings . New York: Academic Press, 196^/, pp. 317-326. 

Griswold, R. E., Poage, J. F. and Polonsky, I. P. The SN0B0L4 Programming - 
Language . Inglewood Cliffs, N. J.: Prentice-Hall, 1968. 

Sidowski, J. B., "Minicomputers", Behavioral Research rletuo d s and Instru- 
mentation , 1971, 2, pp. 267-288. 

Zinn, K. L. "Programming Conversational Use of Computers for I.istructinn", 
in Atkinson, R. C, and Wilson, H. A. (Eds.), Comput er Assisted Instruction: 
A Book of Readings e New York: Academic Press, 1969, pp. 253-268. 



-276- 



THE ADMINISTRATION OF HIGHER EDUCATION: AN EXPERIMENTAL 
APPROACH TO FINDING TMPROVETi PRODUCTION FUNCTIONS 

S. Ray Schultz * 

McConnell and Lamphear (1969), in reporting results of an experiment 
in teaching principles of economics without lectures, conclude that the 
substitution of capital for labor in such a situation can be done success- 
fully. But they caution that this does not necessarily mean it should be 
done. Their reason for caution is that the substitution as they view it 
eliminates student- teacher contact. 

There may be a way between the horns of the dilemina. McConnell and 
Lamphear define pedagogical capital and classroom labor as complete oppo- 
sites. Pedagogical capital, for them, includes only materials created 

by someone other than the professor in charge of the course. Classroom 

✓ 

labor implies only the labor of the professor in charge, lecturing to 
the studisnts. Why not re-define pedagogical capital to include materials 

that utilize the voice and/or picture of the professor in charge of the 

ft 

course, such as cassette recordings and video tapes? Such capital would 
represent the congealed labor of the professor. Wnen pedagogical capital 
is viewed in this way, it may be sensible to push very far in substituting 
capital for labor. 

Again, if capital is define.l to include the professor^s congealed 
labor, then, in response to the caution x-^aised by McConnell and Lamphear, 
it should be asked, ' L'o we have c^ny choice?'^ ' This response is suggested 
in light of the rapidly increasing costs of .higher education, the current 
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recesslon, and the public uneasiness with respect to the college 
community . 

Baumol (1967) has argued that the technological structure of education 
Is such that the quality of teaching, similar to the quality of the live 
performance of a horn r *artet, is judged on the basis of the number of 
Hours used to produce the product (or service). He, Jthus, argued that 
education is a technologically nonprogressive industry. He declared that 
within ^'education, innovations, capital accumulation, and economies of 
large scale generally do not occur and thus, there are not significant 
increases in outpuv per hour of work. Persons who have been studying 
the costs of higher education are agreed that these Qosts have been 
increasing very rapidly. This is prima facie evidence in support 
Baumol^s position. More directly yet, some writers (e.g. lanni, 196A 
and Martin, 1968) say that innovation has been occurring very slowly in 
higher education. lanni says the average time lag between the development 
of a new finding in medicine and its application is two years; while the 
time lag in education is often 30 years. ^ Yet, increasing costs of educa- 
tion, plus an observed slow rate of innovation, do not persuade one to 
agree, with Baumol's view of the technological structure of education. 

A major reason why innovations have come slowly in higher education 
is not the technological structure but rather the incentive system. To 
innovate in teaching has not seemed worthwhile to faculty. They have been 
receiving pay increases and promotions largely on the basis of research 
publications; but experimentation with new ways of teaching is time- 
consuming and competes directly with opportunities to publish research 
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findings. 

However, the tide could be turning now. One reason is that there 
are now several journals that publish research findings based upon experi- 
mentation in teaching. Also, there are now enough new technologists and 
techniques available that there is much research to be done. 

As it now seems reasonable to expect more educational research, 
suggestions for guidelines seem in order. The remainder of this paper 
is presented as one example of educational research designed to move in 
the direction of improved production functions in higher education. 
Experiment in Teaching Business StalEistics (Fall 1969 ) 

In the Fall of 1969, introductory business statistics was taught as 
an experiment: (1) No formal lectures were ^iven. (2) The textbook used 
was programmed. (3) The center of activity was the statistics laboratory 
room. There, students could participate in any one of several activities. 
They could sc^lve laboratory problems. They could discuss statistical 
problems and concepts with one another, the lab assistant, or the professor 
in charge of the course. The professor and his assistant were' present at 
all lab sessions, and they deliberately tried to encourage discussions. 
(4) Students could choose to listen to tape recordings on any one of six 
major topics in introductory business statistics. These recordings were 
accompanied by parallel written material. The student, to gain from this 
procedure, had to listen to the tape recorder, while at the same time, look- 
ing at the parallel written material and occasionally responding in writing 
on the parallel written material before him. This was similar to a pro- 
grammed technique, but with the student listening as well as seeing and 
responding; but also he could be doing all this while in the midst of 
several other students who might be doing the same, or might be working on 
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lab problems or discussing them with one another, the assistant, or the 
professor. (5) There was limited self--pacing , until after the first 
quiz was given. Students were allowed to Ghees'^ the day for taking that 
first quiz, provided they took it before a specified deadline date. 
(6) The total environment was quite free and informal. Students were 
encouraged to talk freely with one another and/or le lab assistant 
and/or the professor, as they chose. Students were encouraged Ito move 
about the laJrher spacious room, to sit whene^^er and wherever they chose, 
and in fact to leave or enter the room as th€'.y chose. This objective 
seemed to be accomplished. At several times during the quarter, students 
who were not in the covirse entered, sat down, and talked together, appar- 
ently without realizing that a class was in session. 
Theoretical Framework and Model Uf-ed in the Analysis 

Most of the data used for analysis were obtained by administering 
a questionnaire to all students in the course, after they completed the 
final examination. The questionnaire was designed to provide the infor- 
mation needed for estimation of the parameters of a linear multiple 
regression model. Such a model could be written as follows: 

X = A + B^X^ + . . . + B X^ 
1 2 J p P 

The letters. A, B2> B^, . . . B^ designate parameters. The "B" values are 
regression coefficients. In this particular model, X^^ refers to number 
of hours per week the student worked for income while he was in the course. 
B^c^ should be interpreted as follows: Suppose B^^^ = -0.27. This would 
mean that on the average, for each additional hour of work per week for 
income while the student was in the course, his grade in the course 
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declined by the amount, 0,27 of a point. The equation actually fitted to 
the data obtained could be written as follows: 

= a + ^3^3 + • • • + ^p^p» ^^^re a. is an estimate of 

A, b^ is an estimate of B^2> ^nd so on. (The estimators, b_j, b^2> • • • 
bp, being based upon sample data are of course subject to sampling error.) 

The grade in the course was the dependent variable. The independent 
variables are broadly described by the following subsets: (1) background 
of th^ student, (2) the student *s manner of operation while in the course, 
and (3) the student *s attitude toward the way in which the course was 
conducted. 

The subset of background variables is as follows: X2 is lack of fear 
of mathematics; is age of student; X^ is exposure to mathematics in 

f 

senior hi^>h school; X^ is exposure to mathematics in college. "Exposure" 
implies only the number of courses taken, and does not include either the 
level of sophistication of the courses or the grade earned. Xg is number 
of years spent studying foreign languages; Xy is number of years spent 
studying music. Both Xg and Xy were included, on the assumption that the 
more a student had worked with symbols, the more successful he would be in 
learning statistics* X^^ is mariral status (single, zero; married, one); 
Xjg is total exposure to mathemaUz-CS in senior high school and college 
(merely the sum of X^ and X^); X^^y is number of college credit hours 
completed before the student entered the course (regarded as a measure of 
academic maturity); X^g is the verbal SAT score, X2Q is the quantitative 
SAT score. 

The subset of variables designed to describe the student's manner of 
operation while in the course is as follows: Xg is amount of discussion 



-281- 



of statistics with the professor in charge of the course; Xg is amount of 

discussion of statistics with the student assistant; X^q is amount of 

discussion of statistics with other students; Xj^^ ^ measure of how 

early the first test was taken, A higher number implies "earlier". The 

earliest date was represented by 15, and the latest, by one. Xj^^ is hours 

worked per week for income while taking the statistics course. "For income" 

was specified, because then "hours worked" should represent an inflexible 

constraint upon the student's time available for studying. Here, the 

direction of relationship was hypothesized to be inverse. X.q is number 

1 8 

of other students the respondent usually worked V7ith on statistics while 
in the course. This variable is similar to X]^o> t)ut the method of 
measurement is different. 

The subset of variables designed to measure the student's attitude 
toward the way the course was conducted is as follows: Xj^j^ is usefulness 
of the taped preser'At-itions ; X-|^2 is the student's evaluation of self-pacing. 
The Findings 

There were 118 students in the courses ;ind a completed questionnaire 
was obtained from each student. However^ SAT scores were not available 
for all these students, so the model was fitted for the 66 students for 
whom the SAT scores were available, to avoid specification bias. The 
model was also fitted for all 118 observations for comparison purposes, 
and no significant differences in mean values were found. In the model 
fitted to the 66 observations, wherever the standard error of a regression 
coefficient was larger than the coefficient, that variable was eliminated 
from the models The coefficient of determination, then, was found to 
equal 0r4546, which is significant at the 0.01 level. 
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In Table 1, are shovm the regression coefficient, standard error, 
and computed ''t" value for each variable retained in the model. In that 
table, all signs shown are hypothesized, except the sign attached to X20> 
the quantitative SAT score. From this result, ability in mathematics as 
measured by the SAT. quantitative score is not directly related to success 
in learning applied statistics. If there is a statistically significant 
relationship, it is inverse. This result is not entirely unique. Paden 
and Moyer (1969) found an inverse relation between the amount of mathematics 
students took in college and how well they performed in economics. Further, 
a report from both Harvard and the University of Michigan (1970) indicated 
that those who had studied mare mathematics did not perform in stat '.sties 
as much better as might have been expected than their colleagues. But 
now, are we to believe that the more ability a student has in mathematics, 
as measured by the quantitative SAT score, the less success he will have in 
learning applied statistics when taught in the manner described in this 
article? Further light on this question may be shed by the simple correla-* 
tion coefficients for the full model. These are shown in Table 2. 

Referring to Table 2, it appears that, 'students who had higher quanti- 
tative FAT scores tended to have less fear of mathematics than other students 
and had higher verbal SAT scores. Both thesa variables are significantly 
and positively related to success in learning applied statistics. It may be 
that ability in mathematics is important for learning stacistics, but that 
manipulative skill is not the critical component. The quantitative SAT 
score (X2q) is significantly and inversely related to Xg and X^q, the 
amount of discussion of statistics with the professor and with other students 
It may be that the style of learning of f^tudents with higher ability in 
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mathematics ds that they learn quite independently of the professor, 
student assistant, and other students, and that they prefer to learn in 
their own way and without hurrying, when the course is taught as described 
in this article. It may even be that the way the experimental course was 
operated, it tended to be biased against such students. 

Variable Xj^g, *'total*' exposure to mathematics, has a significant 
relation to success in learning applied statistics, but in contrast tc 
^20* ^^is relatioi?. is positive. The relationship of Xj^g to other inde- 
pendent variables is similar to that of X^q, the quantitative SAT score. 
For example, students who had more "total" exposure to mathematics did 
not report more discussion of statistics with the professor, lab assistant 
or other students. Yet, Xj^^ and X20 not correlated together, and so 
these two variables might be taken as independent indicators that students 
who feel they have some ability in mathematics prefer to work rather 
independently and at their own pace in an applied statistics course. 
This could be called a private style of learning. 

Based on Table 2, the variable Xg, amount of discussion of statistics 

with the student assistant, has statistically significant positive correla 

tion with each of the following other variables: Xg, amount of discussion 

of statistics with the professor; Xj^3, how early the first examination 

was taken; Xj^^, hours worked per week for income; Xj^^, number of college 

credit hours completed; and X.^, number of other students worked with. 

lo 

Regression coefficient bg is significant at the 0.01 level. The style of 
learning described here may be termed "socialized" (as opposed to private) 
Variable Xj^2> student's evaluation of self -pacing has significant 

positive zero-order correlation w'.th each of the following other variables 
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Xg, amount of discussioa of statistics v;ith the professor; X^j, usefulness 
of the tape n^cordings; and Xj^^v^^o^ early the first examination was taken. 
But ^o^s -^o^ have significant correlation with either or X^q (dis- ' 
Cussion of statistics with the assistant and discussion with other students). 
Perhaps the style of learning here is "please the professor". 

Lack of fear of mathematics (X2) has a direct relation to succesEi in 
learning applied statistics. But this also means that the format of the 
course, stressing informality and openness, did not dissolve this fear and 
its impact upon success in learning statistics. When this course was 
taught the next quarter by the same professor and assistant with a conven- 
tional format including a conventional textbook, two hours of lectures per 
week and no self-pacing, the fear of mathematics was still found to have a 
significant and inverse relation to success in learning statistics. 

The variable, hours workedper week for income (Xj5), was found to be 
significantly and inversely related to success in learning statistics (as 
expected). From Table 2, it is clear that there is significant correlation 
of Xj^ with only one other independent variable, namely X^^ amount of 
discussion of statistics with the assistant. The suggescea style of learning 
here is "get the answer, don't worry about the process". When the same course 
was taught the next quarter in a conventional manner, including two hours of 
lecturing per week, X^^^ (hours worked per week for income) was not signifi- 
cantly related to success in leari^ing statistics. Perhaps in this case, 
students working for income substituted the lectures for other, more time- 
consuming activities, such as reading the textbook. These students may also 
have the style, "get the answer, don't worry about the process". 



Policy Implications 

On the basis of the experiment and the statistical findings reviewed 
above, the lollowing characteristics of a course in applied statistics for 
students such as those found at Cleveland State University seem reasonable: 
(1) Lectureless. (2) The textbook, if conventional, should be so clear 
that Srtudents can resolve most questions themselves; or it should be pro- 
grammed. (3) Cassette recordings and/or video tape recordings can be used, 
with the professor in charge of the course making the presentations. This 
feature is worth trying again, partly because it helps make self-pacing 
possible. (A) Laboratory problems would be assigned to students and would 
be graded by the assistant. (5) Both the assistant and the professor would 
be available at specified times and places, for students to talk with them. 
(6) Advisory-group teaching, (7) The advisory groups could be self-pacing, 
with each advisory group arranging with the professor how often it would meet 

with him as a group. (8) It might be well to have an oral as well as a 

« 

written component to tie final examination. 

A course taught as suggested above wo-^^ld be more efficient in use of 
space tnan it would if taught in the conventional lecture and lab manner. 
The programmed textbook and cassette or video recordings eliminate the 
argument for assembling of students in a lecture hall two to four hours per 
week. 

Personal, individualized and group discussions with the professor can 
be provided for within the IcboraiOiry room. The assistant would be in 
charge of the laboratory and woul<l attend each hour it was open to the 
students. His availability there would apparently be important especially 
to the "socialized learning'* and the "get the answer, don't worry about the 
process" groups. 
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The professor could be in the lab room on a regularly scheduled basis, 
but perhaps only one hour per week for a class of say, 80 students. Of these 
80, those from the "socialized learning" and the "please the professor" groups 
presumably would be the ones interested in talking with the professor. On 
this basis, efficiency in utilization of the professor's time may be much 
iiaproved over the conventional approach. Out of a class of 30 students, 
from the experiment, not all choose to talk with the professor at all; 
which means, of course, that 80 sttidents can be served by the professor 
because they do not all desire his personal attention. But of course, they 
are still influenced by him, through his organization of the course, choice 
of textbook, video tapes and/or cassette recordings and choices of laboratory 
problems for them to solve. If an eight-hour load is taken as the number of 
contact hours, then at 80 students per "class", an eight-hour load would 
imi»7,y 640 students for one professor in one quarter. 
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Table 1 

Regression Coefficient, Stand. Error, and Computed "t" 
Value for Each Independent Variable in 
Success in Learning Statistics Model 



Variable 


Regress ion 
Coefficient 


Standard 
Error 


Computed 
"t" Value 


X2 




Lack of fear of mathematics 


1.02247 


0. 


44489 


2 


29825^ 


Xg 




Amount of discussion of sta- 
tistics with assistant 


1.41875 


0 


41301 


3 


.43514^^ 


^12 




Student's evaluation of self- 
pacing 


0.5C171 


0 


40366 


1 


24291 


Xl5 




Hours worked per week for 
income 


-0.27347 


0 


07492 


-3 


.64995^^ 






"Total*' exposure to 
math ematics 


0.34289 


0 


14286 


2 


40026^^ 


^19 




SAT score: Verbal 


0.02098 


0 


01254 


1 


67286^ 


^20 




CAT score: Quantitative 


-O.C1986 


0 


01347 


-1 


.47474 



S = Significant at the 0.05 level but not at the 0.01 level when a 
one- tailed test is applied. Tabular **t" value is about 1.671 
for a one-tailed test. 

SS-* Significant at the 0.01 level whfm a one-tailed test is Applied. 
Tabular '»t" value is about 2,390 for a one-tailed test at the 
0.01 level. 
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Table 2. Slatple Correlation Coefficients of "Success in Leartilng StatlstiCB" Model 





Grade 

In 
Course 


Lil^ck of 
Fear of 
MaChe- 
maClcs 


Age 
of 
Student 


to Math 
In High 
School 


Ejrposure 
to Math 
In 

College • 


Yeori of 
Foreign 
Leinguoge 
Studied 


Ycors 
of Kusic 
Leseona 


Discuss- 
ion with 
Professor 


Dlscuss- 
ICT with 
AaslsCant 


Discuss- 
ion vlch 
Other 
Students 




H 


X2 


^3 


X4 


^^5 


^6 


X7 


^8 


Xg 


^0 




1.000 


S 

.2510 
1 .000 


-.0&A8 
-.2112 


.1545 
.1434 


.1745 
-.1525 


-.1533 
-.0895 


-.0677 
-.0607 


S 

.2^62 
-.0398 


SS 
.3226 
.1428 


.1070 
-.0763 


^5 






1.000 


-.2004 
1.000 


SS 
.3035 

1.000 


-.0194 
0698 
'.1095 


-.0546 
-.0564 
-.0294 


.243? 
„ 1399 

. 1102 


.0851' . 
-.2199 
.0940 


-.0692 

— . Lhjj 

.2396 


X6 

xa 

X, 
Xjo 












1.000 


SS 
.3512 
1.000 


. 1327 
.0437 


.2228 
.1608 


1 -.0*248 
-.i470 










• 






1.000 


.462^^ 
1.000 


S 

.2636 
.2378 
1.000 






Table 


2. Sloiple 


Corrr.»latlon 


Coefficients of 


''Success 


In Learning Sti 


»tlatlc6" Model 








I'seful- 
ness 

of 
Tapes 


Evaluat- 
ion of 
Self- 
Pacing 


Hov Early 
First Exam 

wss Marital 
Taken Stotua 


Hours 
Worked 
Per Week 
for 
Incoine 


"Total'' 
Exposure 
to 
Mach 


Nunibcr 
of Coll- 
ege 

Credits 
CoroplcCed 


Number 
of Other 
Students 

Worked 
With 


Verbal 

SAT 
Score 


Quantitative 

SAT 
Score 




^1 


^2 


^3 


^14 




^16 


^17 




Xj9 


^20 




.0602 
.0222 


SS 
.3268 

.2138 


.2251 
•.0903 


-.1)253 
-.C830 


SS 
-.3389 

.0275 


. 2^48 
-.0151 


S 

• £fsr2 

t, ' 0 


. 1222 


S 

. Zoo> 
- . 0320 


- 0014 

SS 
.3680 


H 


.1986 
.0498 


-.0816 
.0290 


•,0733 
-.0316 


SS 
.3311 
.1347 


.0729 
.0064 


. 0864 
XXX 


30CX 
-.0513 


385!^ 
-.2081 ^ 


. 1025 


1455 
.1090 




.1371 
.1S86 
.^62 

.2692 


•.0091 
.0359 
.0079 

SS 
.3668 


.0321 
.2070 
.1228 

SS 
.5178 


,337!^ 
-.1409 
-.0365 

-.1147 


-.0191 
.2253 
.0224 

-.0400 


XXX 
-.1178 
-.0511 

-.0113 


XXX 
-.0754 
-.0249 

SS 
.3037 


.1125 
.0451 
-.0107 

5S 
.2948 


.061? 
.1437 
.0625 

.0666 


-.08^8 
-.0530 
-.0070 

SS 
-. 2865 


X, 
XlO 


.0930 
-.0X55 


.1778 
.1806 


S 

.2461 
.1436 


-.0056 

S 

-.2882 


S 

.2642 
.1134 


-.0769 
.0705 


S 

.2600 

bo 

.4675 


SS 
.3174 

XXX 


.0867 
SS 

-.3020 


-.0272 

s 

«.2797 


^1 


1.000 


SS 
.3411 


.1269 


.1496 


.1486 


.1217 


.1009 


.0744 


.0967 


-.0012 


Xi2 




1.000 


S 

.2805 


-.1344 


-.1841 


.0119 


,0790 


.0776 


.0923 


.069 5 

SS 
".301.9 


Xl3 






1.000 


-.1383 


-,1027 


.0040 


.1694 


.1707 


.0680 


X^" 
Al 

^18 








1.000 


.0074 
1.000 


SS 
.3210 
-.0174 
1.000 


.0758 
-.0371 
XXX 

1.000 


-.1960 
.1521 
-.0630 

S 

.2575 
1.000 


-.0040 
.2051 
.0718 

.0903 
-.0063 


.0570 
-.0649 
.0075 

SS 
-.2960 

-.1817 




















1.000 


S 

.2600 
1. 000 



S " SlSAlflcant at the 0.05 leval but not ot the 0.01 leval (two-tailed t«6t;/7 q.OS " 0.2t,2B)> 
SS - SlgnlZlcanC «t tho 0.01 level (Cwo-talled Ceot;/7o.0l " 
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REPORT ON AN EXPERIMENT IN PROGRAMMED INSTRUCTION IN BEGINNING GERMAN 

Ella R. W. McKee * + 

During the academic years 1970-1971 and 1971-1972 several sections 
of beginning German have used programmed materials. In the first year 
the material was divided into two quarters; in the second year the text- 
book was supplemented with additional materials and was used ovex three 
quarters- In addition, during the second year another sequence was begun 
in the Winter quarter with a different' instructor. In these three 
sequences, 158 students were enrolled at the beginning of the first 
quarter; a total of 270 students registered in the eeven courses offered 
thus far. Presented here are data collected coi^cerning the effectiveness 
of the program, and some conclusions and recommendations are made- 

DESCRIPTION 

Common to all three sequences has been the programmed textbook 
(Ruplin-Russell, Basic German , published by the New Century Division of 
Appleton-Century-Crof ts) and the accompanying tapes. The texthpoic is 
printed by a special process so that the answers in the drills appear 
when an Access Marker is used. Each unit has six frames of drill material; 
for four frames the correct forms are in the textbook and are given on the 
tapes. In each of these frames the tapes include one, two or three check 
Items not ±h the textbook. These help the student to determine the extent 
of his mastery of the material. Two frames (three and six) are test 
frames, for which the correct forms are not ava^.lable. Also common to all 



* Professor of German, Cleveland State University. 

+ Aided by the Annie Webb Blanton Scholarship Fund of Delta Kappa Gamma 
(Ohio Chapter) w 
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sequences was the fact that the students in the programmed sections 
were an average cross-section. In the first two sequences all students 
registering for Beginning German in block five were autonatically in 
programmed sections; in the third sequence it was block six. In the 
first year, the students did not know in advance that this would be 
the format* As a result, some of them dropped out the first day. Since 
the first year we have used a different numbering system (111, 112, 113 
for programmed sections instead of the regular 121, 122, and 123); conse- 
quently, the initial drop-out was considerably lower. 

Because of the exigencies of space, the external arrangements during 
the two academic years were different. The only language laboratory 
facilities available <iuring 1970-1971 were Dial-Access, which did not 
provide student control of the tape for frequent repetition, necessary 
for programmed materials. Therefore, a special laboratory was set up 
in Mather Hall with ten tape recorders* A work-study student was avail- 
able for record keeping and for providing tapes and test materials. Some 
of the time this student was a German major who was of real service in 
answering questions. Since my office was also in Mather Hall, the students 
found it easy to come for help whenever they had difficulty. All of them 
availed themselves of this opportunity, so it became an important feature 
of the program. During 1971-1972, we used the new language laboratory 
facilities in University Tower which provide indiv Idual booths with 
cassette tape recorders in addition to the Dial-Access equipment. The 
booths makt? the vocal repetition of material possible, and the cassettes 
are easily duplicated so that students can also use them on their own 
recorders. The present arrangement is much more economical; however, a 
certain esprit de corps which developed Inst year in the special laboratory 
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arrangement with ready access to the instructor has been missing this 
year, and the availability of majors for help in the laboratory has 
been reduced. 

During the first year the only \iiaterials used were the textbook and 
the accompanying tapes. For the second year, a manual was prepared 
coiitaining additional explanations, a vocabulary list for each unit, more 
drills, and exercises for oral practice. This was supplemented with tapes. 
In addition, a test was prepared for each unit and a composite test for 
every three or four units. Answers for frames three and six in each unit 
were available in the laboratory so these became study units instead of 
testing units. These additions and changes were the direct outgrowth of 
recommendations of students who had completed the two-quarter sequence 
in the first year. In a survey of this same group during the past Spring 
quarter, the general reaction was that these changes were helpful. One 
person, however, objected strenuously to the expansion of« the course to 
three quarters. 

During the first year, the class was arbitrarily divided into four 
sections of equal size (eight to twelve students), each section meeting 
once a week for conversation, drill, questions and answers. Because of 
the small numbers, every student had an opportunity^ to participate in the 
conversation, and there were opportunities for correction of pronunciation 
and construction. Students could attend more than one session, if they 
wished. 

During the second year, the class periods were divided into three 
groups. One of these, with optional attendance, was designated as a drill 
session and vzas devoted to explanation of the current grammar, oral and 
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written drill at the board , .questions and answers. The other two hours 
were for oral practice. Students were expected to attend one of the oral 
practice sessions for each unit, or a total of fourteen hours for each 
quarter. They could also attend additional sessions, if they wished. 

In both years, oral tests were an important part of the course. 
During the first year these were tests recorded by st'idents on tape. In 
the second year, the students saw the instructor individually for the 
oral tests* During each quarter, there were three or four of these tests 
ranging from eight to fifteen minutes apiece. 

The third sequence, begun in the Winter quarter of 1972, was taught 

by Dr. Charlotte Koerner. She used the same materials: textbook, coiraner- 

r 

cial tapes, supplementary manual and tapes, unit and composite tests* 
During the first quarter (after two weeks) she divided the class into three 
groups: Fast, Normal, and Slow, each group meeting once a week. There 
was also c\ drill session once a week, which xras optional :gor the fast and 
normal groups and required for the slow group. Towards the end of the 
quarter, the normal and slow groups merged so that these students were 
meeting twice a week. In the second quarter, she used two student assist- 
ants to provide extra drill and practice. The entire class met once a 
week on a voluntary basis, and once a week for dialogs and general work 
for which attendance was required. 

EVALUATION 

A. Efficiency 

The total number of students taking programmed German in these seven 
courses was 270; the actual number of individuals involved, without dupli- 
cation, was 148. 
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Our original plan was to have about eighty students in the programmed 
sequence, but that hope did not materialize so we have no real basis for 
asserting that one instructor could handle a triple student load effectively 
with programming. However, we did average 38,5 students per section 
compared to 24.4 students in the equivalent regular sections in those 
quarters. 

Theoretically, I think it is possible to increase the student load 
per faculty member in the programmed section to eighty students: four 
hours per week in class with twenty students each time, and about five 
hours per week for individual oral testing which leaves about three hours 
a week for grading papers, which would be adequate. Practically, however, 
I am not convinced; one hour per week with twenty students is not really 
enough time per student. The arrangement this year with one hour of drill 
for each unit plus the oral sessions with twelve to fifteen students was 
a much more satisfactory arrangement - and it still represents a consider- 
ably higher student load per faculty member. 

B, Student Reaction 

The students who have had one, two three quarters of programmed German 
have been strongly in favor of nhe method. " Students in the first and 
second sequences, whether they dropped out during a quarter, did not continue 
in the sequence, or did complete a sequence, were asked to fill out detailed 
questionnaires anonymously. We have queried 121 students and have had 9b 
questionnaires returned, or about 81% return. 

The question, *^If you know someone who was planning to take Bogianing 
German, would you recommend the programmed course?** appeared on 56 question- 
naires which were returned; of those 56, 49 checked Yes and only 7 checked No, 
or a percentage in favor of programrning of 87.6. The reasons given for their 
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preference for the programmed course include statements such as these: 

"I am glad I had an opportunity to participate in the progranmied course," 
"This course makes it easy to learn German," 

"The students are in a much freer atmosphere and this will help 

them learn better," 
"I thought this was a good approach to learning a language, I wish it 

would continue through fifth quarter German," 
"Since this is the third time I started second quarter German and the 

first I finished, I obviously like the course, mainly because 

there is little pressure applied to learn, which is good," 
"I feel the course is very worthwhile. It allows us more independent 

study." 

"You can work at your o\-m speed," 

"I like the fact that we could take the tests at our own rate." 

"Its informal approach and the responsibility it offered, although I did 

not live up to it," 
"The smaller classes," 

"The student has more of a say in pressuring himself," 
"You have a good thing going," 
"I think it's great," 

It is apparent from this sampling that the greatest advantage which students 

see in programming is its flexibility and the freedom to structure their work 

individually. That characteristic was also listed as its chief disadvantage, 

with students generally raying that it was too easy to procrastinate, that 

they have to set their o\m standards for achievement and that they may set 

these standards too low. ^ ' ' 

In spite of thd fact that students generally ' complain about compulsory 

class attendance, about one-third of the respondents indicated that they 

would prefer more class sessions. One student said that he had paid for 

four hours of a teacher *s time and he resented having been "gypped." On 

the other hand, another student felt that the necessity for working in the 

laboratory meant that he was expected to be in class twelve hours a week 

instead of four I 

Among the questionnaires returned are those from fifteen people who 
were in the 121 programmed course in the Fall of 1970, and who have now 
completed all their work in German. The first question asked for a listing 
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of grades in the five quarters. The seocnd question (responses in paren- 
theses) was "What wa» your feeling about your background in 121 and. 122 as 
you went to successive courses?" "I felt that my background in 121 and 122 
was 

1. superior to other people in irty class." 

2. on a par with other people in my class" (four students). 

3. somt^what poorer than that of other people in my class" (six students). 

4. seriously poorer than that of other people ia my class" (four students) , 
Of the four students who checked the fourth answer, two had been very weak 
students in the first tx^o quarters, as shoxvrn by the grades listed in the 

first question on the questionnaire^ but they had survived because of the 
slower pace which they could follow. The other two had done B work in the 
programmed course and continued ath the B level in the later courses, but 
they felt that they had difficulty because they were too accustomed to 
listening to taped voices and, therefore, found it hard to adjust to free 
conversation in a class situation. 

Of the six who felt that they were somewhat poorer th.in other students, 
four had received a D in both 121 and 122, which would ind*j.cate that they 
were almost sure to have problems • Two had received C in 121 a'l^d 122 « but 
they were both very much on the borderline. 

All of the fifteen students in these groups felt that completing the 
course in two quarters had resulted in considerable superficial learning. 
It will be interesting to see how this year's students, who have had three 
quarters in which to cover the same essential material, will fare in 124 
and 125. 

It is apparent that the subjective data indicated by the questionnaires 
are not conclusive, although the trend sviems to favor programming. 
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C. Student Performance 
1. Grades 

The statistical data which I have collected are equally open to 
several interpretations and can hardly be called conclusive. 

Table I shows a comparison of percentages of grades achieved by 
three groups of students: 1 - students who began Beginning German in 
the programmed section in the Fall of 1970; grades were tabulated for 
those who continued in subsequent courses; 2 - students who began 
Beginning German in the regular sections in the Fall of 1970; grades 
were tabulated for these students who continued in subsequent courses; 
3 - all students registered ixi 122, 123, 124, or 125 in equivalent 
quarters . 

On the basis of the percentages in Table I it is apparent that 

the pattern of grades established in the first two quarters of the 

programmed course remained relatively consistent throughout the other 

< 

quarters in regular sections. 

In the programmed section we were dealing with an initial group 
of sixty-four students taught by one instructor; ir the regular sections 
we had initially seventy-eight students taught by four instructors. In 
the second quarter we had a continuing group of fifty-two students in 
the programmed section, taught by one instructor, and thirty-five 
continuing in regular sections with twenty additional f>tudents (or a 
total of fifty-five students) taught by three instructors. Keeping that 
faculty-student ratio in mind, one sees that variations in percentages 
of grades earned by students in programmed and in regular sections are of 
minimal signif icance . 
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Table I - Comparison of Grades Achieved by Students 





Enrolled 


in Bcsinninff 


OeTTTifln n n Pall 


1 Q7n 






121 


122 








A - 1 


6.2 % 


5.7 % 


7.4 % 


12.5 % 


16.6 ; 


2 


10.2 % 


14.2 % 


14.3 % 


20.0 % 


14.2 ; 


3 




12 7 7 


-L X . H /o 






B - 1 


25.0 % 


23.0 % 


25.9 % 


25.0 % 


41.6 ; 


2 


18.0 % 


37.1 % 


28.5 % 


25.0 % 


35.7 ; 


3 




27.2 % 


29 .5 % 




* 


C 1 


28.1 % 


32.6 % 


40.0 % 


25.0 % 


16.6 ; 


2 


21.8 % 


25.7 % 


50.0 % 


AO.O % 


50.0 : 


o 




21.8 % 


39.3 % 


* 


* 


D ^ 1 


15.6 % 


13.4 % 


18.5 % 


18-7 % 


16.6 : 


2 


10.2 % 


11.3 % 




5.0 % 




3 




10.9 % 


8.1 % 


* 


* 


F - 1 


6.2 % 


5.7 % 


3.5 % 


6.2 % 




2 


14.1 % 


2.8 % 




5.0% 




3 




T ft 7 








W - 1 


18.7 % 


19.2 % 


7.4 % 


12.5 % 


8.3 


2 


24.3 % 


8.5 % 


3.5 % • 


5.0 % 




3 




23.6 % 


9.8 % 


* 




P - 1 










8.3 ' 


PHR 1 


2.24 


2.11 


2.24 


2.21 


2.63 


2 


1.96 


2.56 


2.55 


2.52 


2.64 


3 




2.45 


2.42 




* 



(* - Because stud exits who had completed 123 took their 124 and 125 courses 

at such diverse rates, it was impossible to find equivalent courses for 
comparison purposes.) 

(** - The point hour 'ratio is a composite figure for the entire class.) 



One possible explanation for the higher point hour ratio for 122, 
123, and 124 in the regular sections may be the higher rate of F*s in 121: 
6.1% for programmed and 15.4% for regular sections. It would seem that 
weaker students made it through the five quarters of German with a 
programmed background, which allows for self-pacing, although their grades 



continued to be low in tht regular sections. In the regular sections of 
121 such weaker students were eliminated with F's. 

The pattern of grade percentages for the other two sequp.nces of 
programmed German in comparison to regular sections in the same quarters 
is sufficiently similar to that of the first year that it seems unnecessary 
to include the detailed figures here. The point hour ratio for each of 
the classes involved shows quite clearly the similarity in grade percent- 
ages. 

It is apparent that there have sometimes been wide differences 
between grades achieved in programming and in the regular sections, but, 
considering the whole pattern, there has been essential similarity, in 
spite of the fact that the f aculty^student ratio has been much higher 
for program and that on the surface it appears that there was less 
contact in class under programming. 
2. Proficiency 

Another measure for the effectiveness of the programmed approach 
is the scores on the Modern Language Association test which is used as 
a placement test for students en*:ering college with high school German. 
This test has been given our own students on several occasions in order 
to establish and validate norms. Mr. Carl Finkbeiner in the Testing and 
Counseling Office did a comparative study using the scores made by 
students last year after two quarters of programmed work and this year 
after three quarters of programmed work. I quote his report in its 
entirety: 

"A case may be strongly made that a distribution of scores 
may be adequately described by its mean and standard of deviation 
(an index of variability) without losing much essential information. 
The t-test, which was used here, tests the hypothesis that the 
various distributions, as described by the means and standard 
deviations, overlap so much as to be indistinguishable. 
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Table I 







Listening Reading 


, Total 






Mean 


S . D . Mean 


S. D. 


Mean 


S. D. 


122 


reg. 


22.63 


7.98 21.17 


6.88 


43.79 


14.13 


122 


exp . 


18.13 


8.08 16.43 


8.47 


34 . 53 


15.67 


123 


reg. 


22.81 


8.29 25.96 


8.77 


48.77 


15.91 


123 


exp . 


26.61 


8.13 24.94 


10.76 


51.56 


18.14 








Table II 












Total 












Difference 






Signif: 


Grp . 


. 1 vs 


. Grp. 2 


Grp. 1 - Grp. 2 


t 


Probability 


Diffe; 


122 


reg. 


122 exp. 


9.24 


2.3705 


.05 


Yes 


122 


reg. 


122 reg. 


-4.98 


1.4178 


.05 


No 


122 


reg. 


123 exp. 


-7.77 


1.5603 


.05 


No 


122 


exp . 


123 reg. 


-14.22 


4.8701 


.01 


Yes 


122 


exp. 


123 exp. 


-17.01 


3.6437 


.01 


Yes 


123 


reg. 


123 exp. 


-2.79 


0.6746 


.05 


No 



"The first ible reports the means and standard deviations for 
erch of the three M.L.A. scores that wp-re obtained from the four 
groups: 122 and 123 regular class (122 ro.g. and 123 reg.) and 122 
and 123 experi:nental class (122 exp. and 123 exp.). The total scores 
for the four groups were then t-tested one against another with the 
results reported in the second table. The two groups being compared 
are reported in the first two columns. The mean Total Score for 
Group 2 was subtracted from the mean Total Score for Group 1 and 
this difference is reported in the third column. The t-statistic 
is reported in the fourth column and in the fifth column is the 
level of significance of that statistic. The sixth column indicates 
whether the between group differences reported in column 3 are 
significant at a traditionally accepted level. Thus, for example, 
122 reg. Is 9.24 points higher than 122 exp. on the average and 
this is a significant difference. 

"I would like to point out a few things. First, no distinction 
may be made between 122 reg. and 123 reg. There was, however, a 
significant difference batween 122 exp. and 123 exp., indicating 
hopefully that there was an experievitial difference between experi- 
mental and regular German classes. Furthermore, there is no distin- 
guishable difference between 123 reg. and 123 experimental which 
would indicate that with regard to those things about German meas- 
ured by the M.L.A. testj the experimental course seems finally to 
have taught as much as the regular course does." 

3. Withdrawals 

In order to determine whether or not the programmed approach was a 
significant factor for students who withdrew from the course, a question- 
naire was sent to every student who withdrew from the course officially 
or who simply dropped out. I include.! those students, too, who received 
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an NR at the end of a quarter and never removed the grade. The percentages 
of these drop-outs for each quarter, together with those in regular 
sections are as follows: 



Table II - Withdrawals 

Programmed Regular 



121 


Fall 1970 


16.2 % 


24.3 


122 


Winter 1971 


19.2 :i 




111 


Fall 1971 


15.7 % 


20.0 


112 


Winter 1972 


20.7 % 


7.1 


111 


Winter 1972 


3.7 % 




1X3 


Spring 1972 


4.1 % 


20.8 


112 


Spring ,1972 


41.1 % 


14.7 



Of the siKty-two students who withdrew or dropped out of the first and 

second sequence, thirty-five answered the questionnaire, or 56.4 %. 

Eleven indicated that they withdrew because they did not like programmed 

study, or 31.0 %. Specific aspects which they disliked were: 

"Wanted or needed more time in class.*' 

"Did not have time or did not want to use lab." 

"Too prone to procrastinate and, therefore, fell far behind." 

"The pace was too fast." 

The other sixty-nine percent dropped the course because they dropped out 

of school, because they were transferring to another college, because they 

were changing majors and/or colleges, or because they were carrying too 

heavy a load. 

It seems apparent, therefore, that withdrawal from language classes 
is not significantly related to the methodology in the class; in almost all 
cases the percentage is similar in programmed classes and regular classes. 

CONCLUSIONS 

I asked Dr. Charlotte Koerner, who taught the third sequence in pro- 
grammed German this year, to comment about her reactions. She wri'es the 
following: 

"From my experience of teaching the first two quarters (Ger 111 
and 112) of Programmed German during Winter and Spring 1972, the 
following observations seem most noteworthy: 
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"1. The approach as practiced in my classes works very weXl, if 
it works at all. Students who take the prograimned course because they 
enjoy working by themselves and self-pacing are unanimous in their 
preference of this method over other methods. However, students who 
don't have this initial motivation tend to get further and further 
behind. Therefore: it is absolutely essential to develop the best 
direct reward situation possible in order to make the course profitable 
for this latter group also. 

"2. Because of the limited class contact time, oral performance 
lags significantly behind that of students on the same level in regular 
courses. Reading and writing, on the other hand, are surprisingly 
successful. Considering the low oral skills, I was also astonished 
at times how good the students' comprehension was. 

"3. Small class size did not compensate for the limited class 
contact time. At present, the greatest problem to me is the fetisdback 
to keap the average student going. 

"I had two assistants (German majors), one a native, the other an 
American student whose own proficiency was on the level of 400-courses 
in general but who is still making the common grammatical mistakes. Here 
'in summary are their comments on the experience, freely translated from 
German: 

"Native - In theory, the structure of the course should be 
effective and it basically is so in p7;actice. There was no lack of 
attempts to motivate the students. Both the teacher and the assist- 
ants took great pains to provide opportunities for learning, improve- 
ment, and rewards. However, many students lacked self-discipline, 
talent, and, especially, true motivation to learn languages. Perhaps 
more supervision and help in the lab and more contact hours would 
bring better results. 

"American - I considered the small size of each group a great 
advantage for the students. It gave them much more drill time per 
class hour. It also made a more relaxed atmosphere possible. On 
the negative side, there was lack of adequate preparation on the 
part of the students resulting in wasted time when we drilled. Tliere 
was a certain amount of confusion when the procedure varied somewhat 
from lesson to lesson. For a beginning language course, there was 
not enough teacher-student contact. Thare was not enough pres-^ure 
on the students to keep up their performance between class meetings. 
Because of the limited contact time, instructors don't get to know 
their students as well as in other courses." 

After five quarters of experimenting x^7ith this approach, on the basis of 

the statistical material presented here and my own subjective reactions, I would 

draw these conclusionsj some of which differ from those of Dr. Koerner and her 

assistants : 
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!• Programming is an option which should be available in Germsn. It 
offers one way to offset to a degree the expensive beginning courses required 
by more conventional procedures. 

2. Some students can do the work successfully without benefit of an 
instructor, but most students profit from some contact with an instructor and 
with other students. 

3. Oral tests are effective. If they are conducted for testing purposes 
only> a tape recording is valuable. If they are to be used for both teaching 
and testing and for contact between instructor and student, the face-to-face 
test is more meaningful. The diffei^ence in time expenditure for the instructor 
Is negligible « The tape recordings have the advantage of being available for 
latv^.r comparison and can be listened to at one*s convenience instead of having 
to schedule individual testing times with st?idents. A combination of face-to- 
face testing with tape recording has distinct advantages. 

4. The self-pacing feature is significant. It is safe to say that every 
student in the five quarters whic?i I taught followed his own pace, sometimes 
moving faster sometimes slower. Its chief advantage is that it enables the 
slower student to move more slowly, hopefully absorbing material more thoroughly. 
However, it appears from the scanty evidence of students who have completed 

five quarters, that these students who paced themselves slowly in the programmed 
courses encountered problems in later quarters because they had to adapt to 
the pace of the class. Unfortunately, during these quarters only two students 
availed themselves of the opportui^ity of completing three quarters of German 
in two quarters. This is a feature that needs development. 

5. Some proponents of programming maintain that students necessarily 
learn the material more thoroughly, I have not found this to be the case 
on the whole. It is true that a student can do more thorough work, but it 




is my impression that most of the students who have taken the programmed 



» 

courses here have been so conditioned by previous experience to partial 
leiirning that they have not been motivated to learn more thoroughly when 
tAB opportunity presented itself. Techniques do not change attitudes of 
students. Those who wii^h to avoid the pain of learning can do quite 
effectively with programming; the attrition rate ir.ay indicate that it 
becomes clear to them earlier that they are doing jus}t that. 

6. Greater individualization is possible under the programmed approach 
than in regular classes; therefore, programmed courses lend themselves to 
the solution of the ever-present problem of the articulation between high 
school and college courses and courses in different colleges. 

7. Because of the small size of the conversation classes and the 
personal contact of the oral tests, I found that I knew these students much 
better lhan those in regular classes. The students also commented favorably 
that they knew each other very well. The strength of bcth the student-student 
and the student-teacher interaction may have been the result of the same 
group of students and the same instructor working together for three quarters. 
4. Recommendations 

In considering the, continued use and further development of programmed 
instruction in German, I see these areas of concern and of possible expansion. 

1. Programmed materials should be developed for 124 and 125 so that the 
students may be able to complete the entire language sequence with programming. 

2. Closer structuring should be developed within the framework of self- 
pacing. Particularly, in the Spring of 1972, students tended to complete 
unit tests but to wait with oral iiests and composite tests until almost the 
end of the quarter. This delay undermined the effectiveness of both the oral 
and the composite tests. 

3» Materials should be developed so that, within the framework of program- 
ming, a student could choose to emphasize one of the skills: e.g. reading 
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more than speaking, or vice versa. 

4. The College of Arts and Sciences might consider a study to determine 
why so many students drop> out of school after one or two quarters. This was 
<j:ertainly the largest single factor in the attrition rate during the five 
quarters of the language sequence for those who began with programming. 
Comments such as these came from drop-outs: 

"Thank you for sending this to me. It shows that some people at 

C.S.U. still care about the student." 
"It is not often that a teacher ... is concerned about his students." 
"I thank you for your efforts ... to listen to the viewpoints of people 

who are often forgotten, once the IBM card marked drop is punched." 

5. Students entering with high school German who do not wish to continue 
at the level indicated by their placement scores should be assigned to pro- 
grammed sections for rypid review of the skills in which they fall short. 

6. All three quarters could be made available in one block so that 
small groups of students in any one quarter at a particular level could be 
accommodated economically. It would be possible also to develop a program 
of interaction between these students at different levels. 

7. Further studies might be done to determine how much the students 
in the programmed sections were experimental, as well as by the fact that 
they had the same instructor for several quarters. 



PART THREE 



EVALUATING INSTRUCTIONAL EFFECTIVENESS 



PART THREE 
EVALUATING INSTRUCTIONAL EFFECTIVENESS 

The papers in this section of the monograph were presented at a 
conference on May 8, 1972 titled "Faculty Development: Evaluating 
Teaching" which was sponsored by the Innovative Teaching Group. The 
major goal of the conference was to consider and define the parameters of 
evaluating classroom instruction for the improvement of learning and for 
the profesrional advancement of faculty. Perhaps the outstanding lesson 
of the day, to those who planned the conference at any rate, was that the 
issue of evaluation was even more sensitive a topic than they anticipated. 
And> it is not entirely clear (even yet) that evaluation for improvement 
and evaluation for advancement can felicitously be harnessed together. 
Each of the papers, to one degree or another, acknowledged the profundity 
of this and related problems. 

The first paper by Richard I. Miller, Vice-President for Academic 
Affairs, Baldwin-Wallace College, establishes and identifies the major 
issues. He makes very clear that faculty evaluation must be considered 
within a broad developmental framework which includes sabbatical and re- 
search leaves, summer grants, workshops, post-doctoral scholarships and 
on-'campus programs as well as evaluation. Kach should contribute to a sys- 
tematic program of faculty development. Faculty development, he stressed, 
should proceed in a manner consistent with the overall purposes of higher 
education. He defined those purposes as: (1) to think effectively, (2) to 
communicate thought, (3) to make relevant judgments, and (4) to discriminate 
among values. Having established this general perspective. Dr. Miller then 
discusses a seiries of generalizations about faculty evaluation which are 
predicated upon the view that any system of evaluation should take into 
account the existing relationship between society and higher education 
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today, as well as some "givens" regarding faculty evaluation procedures • 

Professors Richard Fenker and Leigh Secrest describe efforts at 
Texas Christian University to implement a faculty evaluation procedure 
after £ charge to do so was given by the Chancellor of the University. 
The goals of the project were to improve the university by recognizing 
and rewarding "excellence" in all aspects of administrator and faculty 
behavior and to reduce the arbitrariness of the decision-making processes 
associated with promotions, tenure and raises. Both objectives were to 
be accomplished by making the goals and reward structure more explicit. 
The paper provides a valuable look at the "micro-processes" of evaluation 
which developed at TCU and are likely to be involved in the first steps 
anywhere. It is important to note that those involved in the TCU project 
realized and struggled with the question of whether the need for evaluation 
really outweighed implementation problems. They confronted this problem 
first. Implementation itself sparked faculty attitudes which, together, 

4. 

amounted to resistance. Some of "he problems — political and altogether 
human — encountered by Fenker and Secrest illustrate Miller's 'point that 
even the most rational and perfect of evaluation procedures must be 
carried out by people , who are not always rational. 

The last paper by Professor Robert Blackburn and Mary Jo Clark 
specifically addresses faculty performance as it is perceived by various 
members of the university community, particularly the individual faculty 
member himself. These authors characterize the "academic man" as a 
rather special kind of individual. Of lofty intellectual pursuits, he 
or she finds the world beset with problems which can only be avoided by 
choosing academia as opposed to some ether career.. The authors disagree 
with Miller as to whether enough is known about the evaluation of teaching 
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to start procedures. They cite the lack of valid data and, to that 
extent, seem to support the objections faculty members typically raise 
to evaluation. More important, they imply that, even if valid programs 
were ready, the human factor ought still be accorded high respect. Their 
data indicate the extreme discrepancies between perception of good teaching 
by the faculty member being evaluated on the one side, and his colleagues, 
administrators and students on the other. The finding that warrants the 
most attention relates to the differences in perception held by the 
administrator and the faculty member under review. In other words, if an 
administrator fails to understand that ego is attached to, and protected 
by, high self-esteem, he is bound to sew seeds of confusion, misunder- 
standing and mistrust. 

It will not do to dismiss any of the warnings that this study has 
raised. No one ought to doubt that faculty attitudes toward evaluation 
of their teaching are negative. There are several contributing fSnTtors 
in explanation. Primarily, instructors are inclined to see little that is 
wrong or lacking with the quality of university instruction (i.e,, their 
own). As well, they are generally distrustful of the techniques and pro- 
cedures of evaluation, if for no other reason than the vagueness with which 
many evaluation schemes are presented. Faculty, moreover, have understand- 
able difficulty in seeing how evaluation is going to improve their lot in 
these days of tight budgets. And it is difficult for university adminis- 
trators to argue that faculty evaluation is really a vehicle to greater 
rewards rather than being merely an elaborate and sophisticated clocking 
and monitoring tool. It must be said, in all candor, that few universities 
dignify ^his evaluation of teaching by providing sure rewards in salary 
increases, tenure and promotion for those whose teaching is certifiably 
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excellent. Where these warnings are not heeded, it may well be the 
administrators' need to be forward looking which is being fulfilled by 
evaluation rather than legitimate concern for improved learning. It is 
fairly easy to predict that faculty will resist evaluative efforts if 
the most obvious outcome will harm them personally. 

Despite the difficulties and legitimate sensibilities, it is 
probably in our age of "accountability" that the pressures for evaluation 
will become insufferable. The creative and caring administrator will 
seek to involve the individual in the establishntent and implementation 
of Workable, equitable and understandable evaluative procedures and 
standards. The administrator will strive to ensure that the faculty 
member's rights to fair review on issues of merit, to honest feedback 
to developmental assistance, and to unprejudiced appeal are guaranteed. 
For his part, the faculty member ought to take the lead in subjecting 
his teaching to evaluation and using the feedback for improvement. 
Evaluation of teaching, in the service of stimulating student learning, 
can be a legitimate procedure, so long as it also serves the faculty's 
need for esteem and recognition. 
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THE FEASIBILITY OF FACULTY EVALUATION 
Richard I. Miller* 

This conference is scheduled to focus upon improving academic 
performance through evaluation of teaching, or viewing faculty 
evaluation as sn aspect of faculty development. Those who initiated 
today's workshop are to be commended for coming to grips with one 
of the most sensitive aspects of academic life. The problem is not 
new, as Dr. Logan Wilson, former president of the University of Texas, 
pointed out over 25 years ago in The Academic Man : "Indeed, it is no 
exaggeration to say that the most critical problem confronted in the 
social organization of any university is the proper evaluation of 
faculty services, and giving due recognition through the impartial 
assignment of status." (Wilson, 1942). 

I would like^, to return to a phrase used in the opening sentence: 
"improving academic performance through evaluation of teaching." The 
use of this phraseology represents my commitment to viewing faculty 
evaluation as a "means" rather than an "end" — a "means" toward 
accomplishing the broader purposes of higher education* A Harvard 
Committee developed in 1945 what has become a classical statement of 
general purposes of higher education. The intervening years have 



* Vice President for Academic Affairs and Dean, Baldwin-Wallace College 
Berea, Ohio. 
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sharpened the need for higher education to define its mission and seriously 
to consider the four traits mentioned in the Harvard Report: The ability — 
to think effectively, to communicate thought, to make relevant judgements, to 
discriminate among values (Harvard, 1962). 

In view of my assignment, I will refrain from discussing faculty 
evaluation in relation to institutional goals and directions, which is 
a subject worthy of a paper in itself. It is difficult to judge progress 
in faculty development without some knowledge of desired directions. 

A second dimension of the means-to-end or part-to-whole relationship 

is the one between faculty evaluation and faculty development. One should 

not confuse the part with the whole. Faculty development is the overall 

consideration that includes teaching evaluation, and more. Improving 

academic performance, not only of faculty but of administrators and staff, 

should be very high on the list of institutional priorities. Budgetary 

•I 

allocations of significance are necessary for extensive and meaningful 
faculty programs, which include sabbatical and research leaves, summer 
grants, workshops > postdoctoral scholarships, and on-carapus programs. 

I would like to move directly into the rationale of this paper 
through a series of generalizations about faculty evaluation. This 
approach is predicated upon the view that a system of evaluation should 
develop from certain basic assumptions about society, the particular 
Institution, and the process and procedure of evaluation. 

1 . A national trend toward greater accountability will become 
Increasingly evident in the seventies . Colleges and universities can 
be expected to become increasingly conscious of cost-effectiveness and 
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cost-benefit procedures in the seventies, raxpayers, trustees, and 
donors have a right to expect more eff ient management of institutions 
of higher education that is now p'^esent in some instances, and the severe 
economic conditions demand it. Speaking at the annual conference of the 
American Association for Higher Education, Dr, Clark Kerr stated: "Cost- 
effectiveness of operations will be more carefully examined. If this 
is not done internally, it will be done externally by the new experts 
working for legislatures and governors.'' (Kerr, 1971), 

A note of caution might be sounded at this point with respect to 
possible implications for academic freedom. Some actions by state 
legislatures in the area of accountability have been thinly veiled 
efforts to move in a punitive rather than a positive manner, and in ways 
that may threaten academic freedom. We need to be sensitive to these 
tendencies and to oppose them, 

2 • Faculty evaluation does take place , by someone or by somethin g. 
The question is whether the procedures used and the individuals using them 
constitute an optimal process. As B, J, Priest points out, "Evaluation 
is an inherent element of any organized effort to achieve a goal," 
(Priest, 1967), 

No one likes to be evaluated, and it is a threatening procedure 
regardless of how it is approached. Most of us would prefer to rely 
upon our own instincts and experiences for an ongoing self'-evaluation. 
But such evaluation is limited by its nature, as Cassius pointed out 
to Brutus, 

Tell me, good Brutus, can you .see your face? 

No, Cassius, for the eye sees not itself 
But by reflection, by some other things 
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Whether the individual wishes it, evaluation does take place. This 
point is obvious to the young, nontenured college teachers, but how 
about the older professors who have tenure and detailed knowledge of 
the institution? How are they evaluated? The present situation in most 
colleges and universities has self-evaluation as the prime procedure, 
but is this adequate? If a senior professor never is evaluated or never 
visits classes of colleagues, can we expect him to maintain and improve 
his pedagogical skills? Almost everyone wants to perform better because 
he gains greater satisfaction when things are moving along and when 
improvement is taking place. But is self -evaluation, in itself, 
acequate for providing pedagogical assistance? 

Every college teacher is discussed and analyzed often from midnight 
to 2:00 a.m. And every college teacher is scrutinized by colleagues, 
even if from afar and if upon nonclassroom data. Yet how many professors 
ask colleagues for an evaluation of thedr teaching performance? 

How do professors view teaching evaluation? Gaff, Wilson, and 
others reached this conclusion from their survey: 

"Seventy-two per cent of the faculty said they favored a formal 
procedure to evaluate teaching. Eighty-two per cent of those 
in favor felt that students should be involved in the evaluation, 
76 per cent felt that colleagues and 73 felt that departmental 
chairmen should also be involved ... In a 1970 survey, 85 per cent 
of the respondents endorsed the idea that a formal program of 
teacher evaluations of faculty should be *'used by the college in 
making decisions about such matters as salary, promotion, and 
tenure." (Gaff et al, 1970). 
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3 . Carefully developed faculty evaluative procedures do have 
validity > Some individuals would challenge the validity of evaluative 
procedures in general ani svudent appraisal procedures in particular, 
asking: "How do we know that appraisal procedures are able, to identify 
our:standing or poor teaching?*' In other words, how do we know that 
professors who are highly rated by students are, in fact, outstanding^ 
teachers? The question is a fair one in view of the inadequate research 
basis that has been built in this particular area, but we do have some 
research evidence. The Center for Research and Development in Higher 
Education conducted a study of university teaching for the Davis campus 
of the University of California, with these three principal findings: 
(1) There is excellent agreement among students, and between faculty 
and students, about the effectiveness of give i teachers. (2) Best and 
worst teachers engage in the same professional activities and allocate 
their time among academic pursuits in about the same ways. The mere 
performance of activities associated with teaching does not assure 
that the instruction is effective. (3) Eighty-five items are listed 
that characterize best teachers as perceived by students, and fifty- 
four items are listed that characterize best teachers as perceived by 
colleagues. All items statistically discriminate best from worst 
teachers with a high le.vel of confidence. (Hildebrand and Wilson, 1970). 

The Purdue Rating Scale for Instruction was initially developed in 
1926, and extensive and intensive research has accompanied its various 
refinements. This research, in essence, concludes: "A third of a 
century of use ... by many teachers and a very considerable amount of 
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experiniental research . . . have dGmonstrated that student evaluation is 
a useful, convenient, reliable, and valid means of self -supervision and 
self-improvement for the teacher. (Remmers and Weisbrodt, 1965). And 
from his study of the literature on the question of validity, McKeachie 
writes that, "in summary, student ratings do have some validity- Teachers 
rated as effective by students tend to be those teachers whose students 
learn most." (McKeachie, 1969). 

4. Every system of evaluation can be improved. An institution 
should not seek the perfect system, which will never exist, but neither 
should a system be selected without careful study. In the area of 
instruments for student appraisal of teaching, to take one example, 
several excellent instruments with impressive research bases can be 
found. Too many universities spend time on developing their own instru- 
ment when this time could be better spent on other phases of the overall 
procedures. An institution could select an instrument already developed, 
make appropriate modifications according to its particular nature. and 
interests, and then have more time available for the complexities 
related to developing, implementing, and using a system of evaluation. 

Some universities have attempted to spell out all details and 
answer all questions before the system was introduced. This approach 
suffers on at least two counts. It is more vulnerable to criticism 
because some details will always be left unanswered or left at a 
controversial point, and it may be afflicted with hardening of the 
categories so the modifications that emerge from experience will be 
difficult to accomplish. 

Some academicians will Judge faculty evaluation in terms of 
absolutes. Since techniques and procedures for faculty evaluation 
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are less than perfect and since not all dimensions of the matter are 
covered by solid research, some critics would continue to rely upon 
completely subjective procedures rather than recognize the advances 
that have been made in systems of evaluation and try to make improve- 
ments. The "all-or-none" law applies in physiology but not in human 
relations . 

5. Reliance upon any single input is not desirable. The total 
array of professional activities, with teaching foremost, is too' 
diverse and complex to be fairly evaluated by one input. However, 
one systematic and reliable procedure is better than any number of 
casual and highly subjective ones. In their extensive and current 
survey of the educational literature on student ratings of college 
teaching, Costin and colleagues (1971) reached this conclusion: 

. .We wish to emphasize that student ratings of undergraduate 
teaching fall far short of a complete assessment ot an instructor's 
teaching contribution. . . . Nevertheless, if teaching performance 
is to be evaluated ... a systematic measure of student actitudes, 
opinions, and observations can hardly be ignored. The data which 
have been reviewed strongly suggest that the use of formal student 
ratings provides a reasonable way of measuring student reaction." 
My own work on evaluation of teaching calls for a choice among five 
procedures for evaluating classroom teaching: student evaluation, class- 
room visitation, teaching materials and procedures, special incident, and 
self-evaluation. The specific weighing of all or some of these components 
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are determined by consideration of institutional, departmental, and 
individual needs and interests. 

6. Effective procedure s for gathering , processing , and utilizing 
data are needed* The finest instruments can be for naught if consideration 
is given only to the first step — the development of evaluative criteria. 
This initial step is important — and so are three other aspects; 
gathering, processing, and utilizing data. I will not go into detail 

on these dimensions but only point out something of their contributions 
to the overall success of an evaluative syste:^?p. Gathering evaluative 
data is complex, and- careful thought needs to be given to it. One 
research study compared student ratings of classroom teaching when the 
instructor handed out the rating sheets and remained in the room during 
the ratlnas^ as compared to when the instructor was out of the room 
when the ratings were made. Student ratings were significantly higher 
when the instructor stayed in the room. (Kirchner, 1969). 

Efficient and economical processing is necessary. The use of the 
computer is almost essential for an institution of any size, and such a 
commitment requires time, experience and money. Swift processing of 
the data allows optimum opportunity for study and use of the results. 

And data need to be presented in a non-technical and simplified 
form. Computer printouts and masses of undigested data can be confusing 
and misleading, and accurate data are of little value unless they are 
understood and used. 

7 . Strategy for developing the system of evaluat ion needs careful 
consideration . (Miller, 1972). A summary of some component parts of 
such a strategy might include: administrative support, careful study, 
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trial runs, faculty resistance points, open forums, ample time, systemati 
appraisal- The strategy suggested by Eble (1970) follows this pattern: 

1. Gaining the cooperation of the faculty 

2. Defining purposes, objectives, and uses 

3. Arriving at means and procedures 

4. Making crucial policy decisions 

5. Establishing rm office for cidministCiring the program 

6. Keeping the campus community informed 

7. Financing a continuing program 

8. Maintaining a student and faculty interest and involvement 

9. Conducting follow-up activities and studies 

10. Relating evaluation to other efforts to recognize, reward, 
and improve teaching. 

In conclusion, I would like to return to the title of this paper: 
the feasibility of faculty evaluations. Is a systematic procedure for 
faculty evaluation feasible? My view relates both to research and to 
experience with institutions that have developed or are developing such 
systems. I believe they represent x^hat would be considered dynamic and 
solid academic institutions, perhaps somewhat akin to the aphorism, "the 
rich get richer I** Those institutions in most need of improvement often 
are those that least want it. 

Heisenberg, one of the early leaders in theoretical atomic physics, 
developed the principle of indeterminancy , or the "uncertainty principle, 
which states that the position and velocity of an electron in motion 
cannot be measured simultaneously with high precision. This principle 
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is accepted by scientists as honest recognition of imprecision yet i^.: 
has in no way deterred the relentless pursuit of precision. Something 
of this spirit is needed when one undertakes faculty evaluation. 

In the final analysis, only people can make systems, programs, or 
organizations work. The process of developing, introducing, and maraging 
a system of evaluation is a human problem. The sensitivities and fears 
of individuals are real and need always to be considered in the imple- 
mentation of any system, but a progressive and dynamic university is 
built by accentuating the positive and by moving ahead, (Eble, 1970). 
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TEACHER EVALUATION AT TEXAS CHRISTIAN UNIVERSITY: 
AN ANALYSIS OF THE PERCEIVED ROLES OF FACULTY 
BY STUDENTS, -ADMINISTRATORS, AND FACULTY 

Richard M. Fenker and Leigh Secrest* 
INTRODUCTION 

The dilemma of faculty evaluation is succinctly characterized by the 
following statement of assumed adequacy: administrators "ask for evidence 
of scholarly competence but assume teaching competence/^ And students 
ask for evidence of teaching competence but assume scholarly competence 
(Hammond, Meyer and Miller, 1971), When the ambivalence suggested by 
this statement is coupled with an uncertain and frequently nondiscriminating 
reward structure, frustrations associated with tight academic budgets, and 
the absence of definitive measures for evaluating the many complex aspects 
of faculty behavior, then the cautious outlook many faculty and admini- 
strators have toward evaluation programs can be understood. An awareness 
of these difficulties nevertheless does not greatly mollify the admini- 
strator faced with the practical problem of disbursing rewards or the 
faculty meirber who demands that his achievements be recognized and 
rewarded. Cognizant of many of the pitf:ills associated with evaluation 
procedure, yet pressed by practical needs, TCU decided to implement an 
experimental evaluation program. This paper discusses the issues that 
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were considered in designing the program at TCU and presents data on the 
roles of faculty as perceived by various groups within the University. 

As a result of a self-study program^ suggestions from University 
advisory groups, and impetus provided by the Chancellor, Texas Christian 
University embarked on a full-scale evaluation program during the Spring 
of 1971. The program was intended to meet the following needs or goals: 

1. To improve the overall quality of the University by providing 
an objective means for evaluating its personnel, suggesting 
improvements or changes, and distributing rewards on the 
basis of a sufficiently complex definition of excellence. 

2. To acknowledge the importance of excellent teaching and 
to implement this conviction in the University's reward 
structuna. 

3. To reduce the arbitrariness of the decision-making processes 
associated with tenure, promotions, and raises by making the 
reward structure more explicit. 

4. To recognize the diversification of behaviors that constitute 
"excellence" for a faculty member or administrator and to 
establish criteria for evaluating these behaviors. 

A university committee was appointed to develop evaluation instru- 
ments and if possible conduct a trial run of the evaluation procedures 
during the 1971-72 academic year. 
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Much of the material in the present paper is based on the work of 
this university committee. The paper is divided into two major sections. 
The first contains a description of the activities of the committee in 
planning, developing and implementing the evaluation program. The j;econd 
section presents the results of a ''validation*' study intended to provide 
feedback from faculty, students, and administrators on the suitability 
of the evaluation instruments. The validation data were used to investigate 
differences in the perceptions of the various subgroups within the 
university community, 

THE EVALUATION PROGRAM 
Questionnaire Development 

It was the committee's original intention to develop instruments 
for upward, downward and parallel evaluation of faculty and administrators. 
Although at the time these instruments were designed, it was anticipated 
the upward evaluation of faculty, the teacher evaluation, would meet 
the most resistance, this hunch could not have been more wrong. The 
committee constructed instruments"^ for teacher evaluation (faculty by 
students), colleague evaluation (faculty by faculty), self-evaluation, 
evaluation of professional staff, and evaluation of the state of the 
university. Each questionnaire had a different set of guidelines, 
however, the current paper will be concernnrl only x^ith the teacher 
evaluation. 



Three of these instruments, the teacher evaluation questionnaire, 
the colleague questionnaire, and the administrator questionnaire an^ 
given in Appendix A, 
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The teacher evaluation questionnaire was developed primarily on the 
basis of other successful questionnaires, particularly the one constructed 
at the Davis campus of the University of California (Ilildebrand and Wilson, 
1971), The individual items on the questionnaire were divided into six 
categories, five of which represented the following scales: analytic/ 
synthetic approach; organization/clarity; instructor-group interaction; 
instructor-individual student interaction; dynamism/ enthusiasm. The 
sixth category contained questions related to specific mechanical details 
of the course. Most of the questions selected for inclusion on the 
questionnaire had been sho\m in previous research to discriminate 
significantly between good and poor teachers, 

The colleague evaluation instrument was designed to measure the 
variety of activities that characterize faculty behavior at an 
institution such as TCU. The major categories of faculty behavior were: 

(a) Teaching: classroom and interactions \7ith. individual students; 

(b) Research; current activity, creativity, reputation; 

(c) Participation in university activities: committee assignments, 
role in campus organizations ; 

(d) Admiuis trative responsibilities ; 

(e) Outside professional activities: consulting, servin,^ as a 
reviewer, public speaking. 

A number of the individual items associated V7ith the first three 
categories were selected because in the Davis campus study (Childebrand and 
Wilson, 1971) the items were shown to discriminate between good and 
poor teachers. 
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Political Considerations 

It was apparent to the coimnittee that £?.ny attempt to implement a 
project with the scope and potential impact of a full scale evaluation 
program would generate considerable discussion and controversy, especially 
in f reedoTti-oriented university setting. Before any of the details of 
the proposed evaluation procedures were distributed to the university 
community an attempt was made to anticipate the problems or issues likely 
to be raised. On the basis of these "political" considerations the 
following ideas were stressed in presenting the evaluation pro2;ram to 
the university community. 

1. Tne privacy of individuals would be protected. Public 
distribution of teacher evaluations would not be allowed 
without permission of the faculty member involved. 

2. The evaluation procedures were regarded as experimental. 
Both the form of the ir ^'^^rMments and details concerning 
their implementation vjere not in any sense fixad but 
were to be decided on the basis of feedback from the 
university community. 

3. It was noted that evaluation was currently taking place 
at all levels in the university > and that the purpose 

of the evaluation instruments was to "make more objective 
and explicit the processes of evaluation already at work 
in the university and to provide a process of gathering 
a more complete range of information concerning faculty 
members acA administrators in their work" (TCU Committee 
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Report, 1971). 

4. Open hearings on the evaluation procedure were held by the 
faculty senate with the evaluation coramit tee answering 
questiors and recording suggestions for changes. 

5. The validation study (to be described below) gave each 
individual faculty member and administrator the chance to 
comment on the questionnaires in a constructive (or non- 
constructive) manner and insured that if job requirements 
or teaching styles differed across departments or other 
divisions of the University, this diversity would be noted. 

6. Considerable attention was given to matters of protocol. 
Representatives for various student and faculty groups 
were kept informed of the cotomittee's activities. 
Traditional lihes of communication ("proper channels'^ 
were utilized in distributing and collecting information 
associated with the evaluation procedure. 

THE VALIDATION PROCEDURE 
Purposes and Administration 

Although some of the questionnaire items were validated on the basis 
of previous research, many were not because it is difficult to find 
external criteria related to all of the behaviors being evaluated. Also, 
in many cases the behaviors described on tbj* evaluation questionnaires 
represent the most meaningful criteria for defining outstanding performance, 
thus making it difficult to find associated external criteria. Finally, 
since it was anticipated that the patterns of behavior which characterize 

expected performance might differ across departments, some type of ''face 
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validation'' study was deemed necessary to collect information on these 
differences. 

The validation study was, therefore, in»:anded to provide information 
on the perceived relevance of the items on the various questionnaires, 
net only for the purpose of differentiating between the various university 
groups but in addition to ''validate'' the individual items by demonstrating 
that their importance was commonly agreed upon. Also the validation 
procadure served as a comsnunication device, informing the university 
community of the nature of the proposed program and providing the opportunity 
for some participat icra. Students, faculty and administrators were sent 
copies of all the evaluation instruments and asked to rate each of the 
items in terms of its importance or relevance for the position b^^ing 
evaluated. Thus, both students and faculty ratad the iinpcrt^incs of the 
criteria on the teacher evaluation questionnaire as indicants of good or 
effective teaching. Faculty rated the items on the colleague questionnaire 
for relevance with regard to their own departments. 
Analysis of the Results 

Perhaps the most surprising result of the validation study was that 
with the exception of the colleague questionnaire, the items on the v'arious 
instruments received extremely high ratings. In fact, the average rating 
for all except several of the items on the teacher evaluation questionnaire 
and the administrator questionnaire was between 'Very relevant*' and 
"extremely relevant ' on the response scale. This result was not too 
unexpected since the que?5tionnaire items were selected originally on the 
basis of judged importance t:o the position being evaluated, nevertheless 
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it wac reassuring to have the coiranittee's opinions corroborated by the 
university at large. 

Multiple discriminant analysis (MDA) was used to find the dimensions 
or factors on which the various university groups differ in their responses 
to a particular questionnaire. For example, if there was some disagreement 
between student and faculty as to what constitute the most relevani: 
behaviors for excellent teachers, then MDA can be used to determine the 
extent of the disparity and to define the underlying dimensions. A number 
of researchers have used factor analysis to identify items which have 
similar response patterns across groups or individuals (Moore, 1970; 
Rees, 1969; Meredith, 1969; Hildebrand and Wilson, 1971). MDA techniques, 
however, identify items which have different response patterns across 
groups. With the exception of a single study by Field, Simpkins, Browne, 
and Rich (1971) discriminant analysis procedures have not been (to the authors' 
knowledge) used in the evaluation area. 
Teacher Evaluation Questionnaire 

MDA techniques were used to investigate the differences between student, 
faculty, and administrator responses to the teacher evaluation questionnaire.^ 
In general, there was considerable agreement between the three groups as to 
the importance of the various criteria in defining good teaching. Three 
significant discriminant axis (dimensions of difference) were found despite 
t]Ae. f^eneral agreement on the itev-ns. The first axis represented a "general 
factor with almost all questionnaire items having moderate or high 



Details of this analysis are given in Appendix B. 
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projections. This axis reflects the fact that administrators and faculty 
generally gave higher importance ratings for all the items than did tho 
students. 

The second axis discriminated between underclassmen (freshmen and 
sophomores) and all other groups (juniors, seniors, faculty and admini- 
strators). The dimension represenced the instructor's enthusiasm or 
attention-getting ability. Items such as: **usually held your attention 
during class"; and "revealed enthusiasm in his teaching" were highly 
correlated with the axis. Evidently, the underclassmen considered 
stimulating teachers as more important than the other gro\;ps. 

The third axis was defined by items concerned with the mechanical 
details of the course rather than the instructor. It was interesting to 
note that freshmen rated these items as. considerably less important than 
did the other groups, while sophomores rated these items as considerably 
more important. As before, juniors, seniors, faculty, and administrators 
had similar ratings, l^ile the results of this particular analysis are 
not terribly surprising, they do illustrate the potential usefulness of 
the discriminant technique in evaluation research. 

Faculty Colleague Questionnaire 

The faculty validation responsies to the colleague questionnaire were 
divided by colleges into eight groups (divinity, business, education, 
fine arts, humanities, natural sciences, social science, nursing) and 
analyzed using a multiple discriminant procedure. The administrators 
represented a ninth group. The analysis yielded four significant 
discriminant axes which were interpreted as follows:"^ 
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Dimension 1; This is a bipolar dimension characterized 
on one pole by items that reflect the importance of 
research, and on the other pole by items that suggest a 
"good member of the university community" stereotype. 
Faculty groups who rated the dimensions as highly 
Important are concerned with university committees 
("works well as a member of a committee") , are involved 
in student and faculty organizations, are interested 
in students, and are not especiall> interested in 
research. Faculty groups with low loadings on the 
dimension rated the "good member" items as less important 
and the items related to research as highly important. 
The fact this dimension is bipolar is interesting for 
it suggests that, at least at TCU, faculty fitting the 
"good member" stereotype are no t especially concerned 
\<r±th research and vice-versa. Analysis of the various 
faculty groups' loadings on this dimension revealed 
that the business school and school of education were 
high while the natural sciences and the social sciences 
were low. Table CI in Appendix C lists the relative 
positions of the varioiis schools on this dimension and 
the three dimensions presented below. 
Dimension 2: This is a dimension concerned with the 
breadth of the faculty ("seems well read beyond the 
subject he teaches"), their creativity and their interest 
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in teaching. The humanities have, by a considerable margin, 
the highest score on this dimension followed by the 
divinity school and the administrators. The social 
sciences and the business schoci gave the lowest ratings 
for the items associated with this dimension. 

3. Dimension 3 ; This axis clearly represents a '*local 
visibility dimension" since highly correlated items were; 
"has done work with vjhich you are familiar"; is an active 
participant in the affairs of the academic communities"; 
and, is recognized as an active citizen by the community. 
Groups T-^ith high loadings were the divinity school, fine 
arts, the social sciences and the administrators. Although 
no group gave this dimension a low importance i;ating, by 
relative standards the natural sciences and the business 
school had the lowest scores. 

4. Dimension 4 : This dimension represents a national 
visibility axis and is defined by such items as: "is asked 
to serve as a consultant to other organizations"; andj, 
"has gained national or international recognition for his 
work." The natural sciences, fine arts, and nursing have 
the highest loadings on this dimension V7hile the social 
sciences, the bu/jiness school, the humanities, and the, 
divinity school anchor the opposite enc^ . 

The MDA of the colleague questionnaire data substantiates an earlier 
prediction which v:as that different patterns of behavior are considered 
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most appropriate in different departments or schools. The information 
derived from the analysis would be extremely useful if the colleague 
instrument were used as part of an overall evaluation program. 
THE CURRENT STATE OF THE EVALUATION PROJECT 
The paper thus far has dealt with the more academic aspects of the 
evaluation program, the development of the instruments and an analysis 
of the data obtained from the validation study. This is not the full 
story. As the reader might expect, the entire evaluation project, in 
particular the development of trial instruments and the validation 
procedures engendered considerable discussion throughout the university 
community. Although much of the debate was constructive, the emotional 
overtones of many of these discussions made it clear that there was 
considerable disagreement between various groups in the university as to 
whether there should be ^'objective" evaluation, who should evaluate 
whom, and what purposes an evaluation program could serve. The major 
issues of concern seemed to be associated with the following points: 

1. By far the largest amount of criticism and emotion 
were directed at the colleague evaluation questionnaire. 
It was apparently a difficult instrument to complete 
because it required information of a sort that only a 
faculty member's closest colleagues would be capable of 
providing. Many people felt that implementing such 
procedure would be extremely bad for morale. 

2. Many faculty apparently prefer the subjective evaluation 
of an authority figure, such as a chairman or dean, to 
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any kind of explicit, *'ob jective** questionnaire. The 
possibility of appealing an unfavorable decision with 
the **objective^^ questionnaire data was not an important 
consideration. 

3. Several faculty groups felt that because they were not 
represented on the committee that developed the 
instruments, important considerations were ignored. The 
dissentient groups were invited to send representatives 
to join the committee, and in fact, the individual from 
the business school raised some important issues concerning 
the managerial implications of an evaluation system* 

4. One important argument against all the procedures was 
that they could do the faculty no good, but could cause 
harm. The faculty could not benefit from the evaluation 
program because the university budget was too tight to 
provide adequate rewards for outstanding performance; 
yet, some reprisal could be taken against the faculty 
members who received low evaluations. 

After a careful analysis of the data collected during the validation 
study and the information obtained from the senate hearings and later 
discussions, the committee decided to drop the colleague evaluation 
questionnaire and instead substitute a rating form to be completed by 
department chairmen (and perhaps close faculty associates) . Eliminating 
the questionnaire had an interesting effect on the overall evaluation 
program. There was very little left in the way of opposition to the 
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teacher evaluation or other evaluation instruments. This was a little 
surprising since previous attempts to implement a teacher evaluation 
procedure had not met with general acceptance by the faculty. Although 
it was not deliberately intended, the colleague questionnaire served as 
the "apes hand'^^ in the evaluation system. 

TCU has just completed (Spring 1972) a trial run of the entire 
evaluation procedure with very little commotion or controversy. The 
success of the trial run and the previous success with the validation 
study are probably dependent on two important aspects of the evaluation 
program. First, the Chancellor wanted the program developed. By 
providing the committee with both impetus and the necessary resources he 
made it possible for the committee's x^ork to be effectively channeled 
through all levels of the University. The second important consideration 
was that everyone, faculty, administrators, and professional staff 
were evaluated. This eliminated objections which might be raised from 
groups singled out for evaluation (at many other universities, only the 
faculty are evaluated) , Will the evaluation program accomplish its 
intended goals? We do not know. At least it is possible to collect 
the data. One office is completely filled and things are very quiet. 



'^The ape's hand phenomenon refers to the behavior of an artist (historical 
reality unconfirmed) who painted for the Spanish aristocracy. Bothered 
by the fact that the king insisted on having one change made in each new 
portrait, the artist began painting an ape's hand into each picture* The 
moral is obvious. 

O 
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APPENDIX A. Instruments for teacher evaluation, colleague evaluation, 

and administrator evaluation 
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FORM A.l; TEACHER EVALUATION QUESTIONAIRE 
TRIAL ?UN FORM 



Faculty Meaber^ 



Dept. 



Teaching Observed: Lectures Labs^^ Conf.-Oisc.-Sftn,^ 

(give approximaTe nunber) 



Courso No, 



Other 



(specify^ 



listed 'below are a nunber of statcirrents which describe aspects of instructor 
behavior. Rate your instructor on each of these itews by marking the response 
category that best indicates his position in comparison with other teachers 
you have'had. Rate each iten as thoughtfully and carefully as possible. If 
you foci that you cannot evaluate the instructor on a particular itera or that 
the iten is not applicable for your class, then mark the response category 
labeled "tindtcided"o 

Evaluate your instructor in terms of the degree to which he: 



Year 



ieuester 



CODE 

L - Low Score 

8/^ - Below Average Score 

A - Average Score 

AA - Above Average Score 

H - High Score 

U - Undecided, rtot Applicable 



SCALE 1. ANALYTIG/SYNTHETIC APPROACH 
1* Discussed points of view other than his own 
2» Contrasted iraplications of various theories 

3« Discussed recent developments in the field and presented origins of ideas 
and concepts 

^. Gave references for core interesting and involved points 

5. Chose texts for the course which added depth to lectures and discussion 

SCALE 2. ORGANIZATION/CLARITY 

6. Was well-prepared for lectures or discussion 

7* Used exasples and illustrations which nade the eaterial clearer 

8. Presented the raatcrial coherently, emphasizing the aajor- points and saking 
clear their relationships 

9* Gave adequate instructions concerning assignments 

10. Wrote test questions for which the raaanings were usually clear 

11. Usually returned assignnents proaptly 

12. Paced the courso so that he did not need to hurry over large anounts of material 
toward the end of the semester 

13. Made efficient use of class tirae 

H. Outlined clearly at the beginning of the course his expectations of the class 
and did not surprise you with wajor assignments at the last of the courso 



BA 

BA 
6A 
6A 



BA 
BA 

BA 
BA 
BA 
BA 

BA 
BA 

6A 



AA 
AA 

AA 
AA 
AA 



AA 
AA 

AA 
AA 
AA 
AA 

;.A 
AA 

AA 



SCALE 3. INSTRUCTOR/GROUP INTERACTION 

15. Usually was aware of whether the class members were following his discussion 
or lecture with understanding 

16. Made you feel free to ask questions, disagree, and express your ideas 



BA 
BA 



AA 
AA 
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17. Gave t«sts which providid you with an adequite opportunity to show what you 
havo loarned 

18» Taaght at an appropriate lavel for the course 

19. Explalrxjd clearly and early^ in the sewster how the course grade would bs 
dotoroined 

20. StlBulated you to work on your own beyond what the course itself required 

21. Was fair and inpartial in his dealings with students 

22. Had sufficient evidence, in terns of class participation and written work, 
to evaluate your achievenent in his course 

23. CofiHHjnted individually on your work,, either orally or in writing 
2^0 In his dealings with students seemed to respect then ss individuals 
25. Was available for conferences outside cf class 



SCALt. 4. DYNArilSM/ENTHUSIASM 

26. Usually held your attention during class 

27. Was intellectually stiffiuiating 

28. Revealed cnthusiasn in his teaching 

OTHER IMPORTANT QUESTIONS 

29. classification }.s (a) Fro or So. (b) Jr. (c) Sr. (d) Masters (e) PhO (f) Other 

30. My overall 6A is (a) A (b) B (c) C (d) D 

31. Most of the instructor's tests were (a) objRctive with ^lo individual writing 

(b) fill in the blank or short answer (c) essay (d) corabination of all 

32o The instructor drew the majority of his tests fro» (a) lectures (b) text 

(c) other reading material (d) equal combination of all three 

33« Is the ajRount of work done appropriate to the credit hours received? (i) 
roceived raore than course warrants (b) received the right amount of credit 

(c) received fewer than course warrants 

3^» The size of the class was appropriate for effective presentation of waterial 
and for helping all participants to learn the subject matter: (a) class too 
large (b) class the right size (c) class too saall 

35» Corpared with all instructors I have had, both in high school and in college, 
this instructor was: (a) one of the best (b) above average (c) average 

(d) below average (e) far below average 
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FORM A. 2: FACULTY COLLEAGUE EVALUATION QUESTIONAIRE 

TRIAL RUN FORM 



Individucl Evaluated: 



Departnant^^ 



On thfl average I have contact with bini: Daily^ 



Weekly^ 



Bmonthly 



Cccasionally 



Listed belrv 3ro a nu^nbsr of statenents which describe aspeoi's of faculty behavior. 
Rate ycisr cilleaguc on each of these it?\?s by marking the appropriate response cato 
gory. Your ratings should ba based on a cc:\33rison between the particular indi- 
vidual and tha other neribcrs of his d3paronent/divi<i[on. If you feal that you 
cannot rate hin on a particulcr iter-n or that the iten i.s not applicable for his 
s.ork, than nark the response catr^gcry labeled '-undecided'^ 

Evaluate your colleague in terns of the djgreo to vrhich he: ' 



CODE 

L - Lev; Score 

BA - Below Average Score 

A - Average Scoro 

AA - Above Average Score 

H - High Score 

U - Undecided, f'ot Applicable 



SCALE 1. RESEARCH ACTIVITY AND RECOGNITION 

1# Has gained national or intcrnatio.nal recognition for his work 

2. Has done work with whicii you are faj;;iiiar' 

3. Does original and creative v-iDrk 

^* Expresses interest in the research of his colleagues 

5» Is actively engaged in research work or professions! activities (not rdatsd 
iC teaching) 

6* Koops current with develop[r.ents in his field 
?• Has done vork to which you refer in teaching 
8. Does quality work 

SCALE 2. INTELLECTUAL BREADTH 

% Seems well read beyond tha subject ho teaches 

10« Is sought by you or others for advice on resGarch 

111© Is sought by you or others for advice on acadernic matters 

12» Can suggest reading in any area of his general field 



BA 
BA 
BA 
BA 

BA 
BA 
BA 
BA 



BA 
8A 
BA 
BA 



AA 
AA 
AA 
A.A 

AA 
AA 
AA 
AA 



AA 
AA 
AA 
AA 



SCALE 3. PARTICIPATION IN THE ACADEMIC COMMUNITY 

13» Attends nany lectures and other events on campus 

U» Is involved in faculty organizations or coTufiittees 

15. Is involved in canipus activities that arc associated with students 

16. Is an active participant in the affairs of the acsdafriic co-TJiTiunity 



BA 
8A 
BA 
BA 



A 
A 
A 
A 



AA 
AA 
AA 
AA 
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17- 


Is so.Toone with whon) you have discussed your toacfiing 


L 


BA 


A 


AA 


\{ 


U 


18. 


Expresses Interest and concern aboiit the quality of his teaching 


L 


BA 


A 


AA 


li 


U 


19- 


Expresses interest or concern for tt-e; probler-^s of students 


1 


BA 


A 


AA 


H 


U 


ZO. 


Is available and willing to talk with students on matters of cofjCtfnt 


L 


BA 


"a 


AA 


W 


U 


SCALE 5. ASSOCIATED PROFESSIONAL ACTIVITIES 
















Discharges intra-university duties in an effective manner 




BA 


A 


AA 


H 


U 


zz. 


Meets deadlines 


L 


DA ' 


A 


AA 


H 


t; 


Z5. 


Cooporates with others 


I 


BA 


A 


AA 


H 


u 




V/orks well as a ncn;ber of a co;r;^iLtce 


L 


BA 


A 


AA 


1! 


u 


Z5o 


follows through oa co::)nittce work by appropriate actions and coTiir.unications 


L 


BA 


A 


AA 


H 


u 


Z6. 


l-okcs a positive contribution to the progress of his acadernic unit through 
co.^.Tittee participation 


1 

I 


BA 


A 


AA 


H 


(i 


.SCALE 6. PUBLIC SERVICE OR CONSULTING 














27. 


Makes his talent and tine available to the external community 


L 


BA 


A 


AA 


H 


u 


23. 


Is recognized as an active citizen by the coMnity 


L 


eA 


A 


AA 


H 


u 


29- 


Serves his profession and ccranity by service, consistent with his primary 
obligation as a teacher-scholar 


L 


BA 


A 


AA 


11 


u 


30. 


Is asked to serve as z consultant to other orgsnizations 


L 


BA 


A 


AA 


H 


ii 
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FORM A. 3: ADMINISTRATOR EVALUATION QUESTIONAIRE 

TRIAL RUN FORM 



Individual Evaluated: 



Position 



On tho avorege I haro contact with hin: Dailx_ 
I A sturfant 



Weekly^ 



Monthly^ 



BxRonthly 



Occasionally 



A faculty nc-nbcr 



An acfninistrator 



A professional staff nsfaber 



Listed bnlow ar(5 a nij:\ber of statenents which describe aspects of ad.'ninistrator 
behavior. Rate the above adrainistrator on each of these itenis by narking the 
appropriate response cate'jory. In naking your rating the <:dninistrator should 
bo cor-'psred with other Pd-inistrators at IC'J that you have known. If yofj are 
uncertain about a particular item or feel that it is not applicable in describing 
tho ad.ninistrator's behavior then eark the category labeled "uncertain"* 

Evaluate th* above administrator in terns of the degree to which he: 
SCALE 1. COMMUNICATIONS 





C 0 0 c 


L - 


Low Score 


BA - 


Below Average Score 


A « 


Average Sccro 


AA « 


Above Average Score 


H - 


High Score 


U - 


Ur^Jccidcd, Not Applicable 



I* Con^xiunicatcs with you in a tinsly and respo/jsive manner 




BA 


A 


AA 


H 


U 


?• Conducts decisive conferences and interviews 




BA 


A 


AA 


P 


U 


3» Balances and validates conflicting infon-nation effectively and fairly 




BA 


A 


AA 


H 


U 


Writes letters or makes statements that seldom need clarification 




8A 


A 


AA 


K 


U 


5» Is duly sensitive to your needs for xnfornation 




BA 


A 


AA 


H 


u 


6# Has sufficient contact with you 




BA 


A 


AA 


H 


u 


7o Shares ic^portant data viJiingly -^nd in an organized manner 




BA 


A 


AA 


K 


u 


SCALE DECISION MAKING 














8. Makes sound and tir.ely decisions 


I 


BA 


A 


Ai\ 


H 


u 


9« Gathers pert.inont facts before acting 


' L 


BA 


A 


A;i 


H 


u 


.!<)• Consults with others on Inportant decisions 




BA 


A 


AA 


H 


u 


IK ^^plios policy consistently and fairly 


L 


BA 


A 


AA 


H 


u 


12» Strives to idontify as specifically as posfsiblo all alternatives before 














making a df>ci:;ion 


L 


BA 


A 


AA 


H 


li 


13o Is skilled in participatory decision naking 


L 


BA 


A 


AA 


H 


u 


SCALE 3. PLANNING 














Ho Plans ahead for thoso activities under his cojnizancc 




BA 


A 


AA 


H 


u 


15« Kwkes ti:no for planning by delegating routina work 




BA 


A 


AA 


H 


u 


16. Keeps goals up to dato and clexrly stated 




BA 


A 


AA 


H 


u 


17« Is receptive to constructive suggestions for change 




BA 


A 


AA 


H 


y 


18# encourages initiative ar>j innovation 




BA 


A 


AA 


H 


u 
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SCALE H. OPERATIONS/ACTION 



IS. 


Initiates and suatalns action toward defined goals 


L 


BA 




AA 


H 


t] 

u 


20. 


Assigns dutlos so as to caxlclzo CBpabilitios of thoso Involved 


L 


BA 


A 


AA 


H 


y 


21. 


la sklUod In tho59 spocialties demanded by his assignnsent 


L 


BA 


A 


AA 


H 


U 


22. 


/|)points effective C0!?.niltte6s • 


L 


BA 


A 


AA 


H 


t] 

u 


25. 


VDrk3 wall vith coralttoos 


L 


BA 


A 


AA 


H 


U 


2«>. 


Sustains laooontua of effort toward difficult goals 


L 


BA 


A 


AA 


H 


u 


25. 


Has a sense of quality and standards 


L 


BA 


A 


AA 


H 


tr 

u 


26. 


fncourages initiative and p&rfornrance by delegating tasks effectively to others 


I 


8A 


A 


Aft 


u 

n 


II 

u 


27. 


Oc3onstratcs a clear ur^dffrstand^ng of the role and scopo of his assignments 
and r6sponsibilitios 


L 


BA 


A 


AA 


H 


a 


SCALE 5. PROBLEM SOLVING 














28. 


Is alert to potential probletr.s because plans are not working out in practice 


L 


BA 


A 


AA 


H 


u 


29. 


Is able to cope with unanticipated events 


L 


BA 


A 


AA 


H 


u 


30. 


Gathers all pertinent facts before acting on a f roblofs 


L 


BA 


A 


AA 


H 


u 


31. 


Kno\/$ how to use tba special talents of others ; s an aid to solving problems 


|_ 


BA 


A 


AA 


fl 


u 


32. 


Approaches problem solving on a systematic basis 


1_ 


BA 


A 


AA 


H 


tl 

u 


33. 


Is able to arouse a spirit of dynamic response to a problem without alarwing 
or depressing others unduly 


L 


BA 


A 


AA 


H 


u 


SCALE 6, HUMAN/ PUBLIC RELATIONS 














3^. 


Buoys raorale and instills enthusiasn ' 


L 


BA 


A 


AA 


H 


u 


35. 


Gives proper and gcnarous credit to others for their contributions- 


L 


BA 


A 


AA 


H 


u 


36. 


Strives to help those under his supervision davelop their full potential 


L 


BA 


A 


AA 


H 


u 


37. 


Is availpible for counsel when needed and appropriate 


L 


BA 


A 


AA 


H 


u 


38. 


Understands the university well enough to refer matters to the proper offices 
for effective action 


L 


BA 


A 


AA 


H 


u 


39. 


Constantly strives to broaden both the internal and external perception of the 
goals and accomplishments of the university 


L 


BA 


A 


AA 


H 


u 


w. 


Establishes rxpport easily and is approachable for counsel 


L 


BA 


A 


AA 


H 


u 


^1. 


Takes positive stops to counteract dostructive ruraors 


L 


BA 


A 


AA 


K 


u 


".2. 


Cos.'Jieods positive results and docs not harp about the negative ones 


L 


BA 


A 


• AA 


H 


u 


•i3. 


Inspires you with a sense of purpose and direction 


L 


BA 


A 


AA 


H 


u 
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APPENDIX B. Multiple discriminant analysis of the student, faculty, 
and administrator responses to the teacher evaluation questionnaire 



/ 
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GROUP DISCRIMINANT AXIS 



I II III 

1. Freshmen 2.96 -0,38 -0,72 

2. Sophomores 2.51 -0.24 0.72 

3. Juniors 3.15 -1.36 0.10 

4. Seniors 2.94 -1.58 0.18 

5. Faculty 4.69 -0.81 -0.04 

6. Administrators 4.85 -1.14 0.02 



TABLE Bl. Group means for the three significant 
discriminant axes from the analysis of 
the teacher evaluation questionnaire. 
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Item No , Item Description Projection 

18 Taught at an appropriate level tor 

the course ,76 

26 Usually held your attention during 

class ,59 

16 Made you feel free to ask questions, 

disagree, and express your ideas ,54 

27 Was intellectually stimulating .48 

28 Revealed enthu5tiasm in his teaching »46 

6 Was well-prepared for lectures or 

discussions -.47 

1 Discussed points of view other than 

his own "•61 

29 Most of the instructor's tests were 

(a) objective with no individual 
writing (b) fill in the blank or 
short answer (c) essay (d) combination 

of all -.88 



Chi Square = 69 df = 28 p < .001 

TABLE B2. Standardized projections of questionnaire 
items on the second discriminant axis? 
Items with projections less than 0.4 were 
omitted. 



^ The first discriminant axis is not presented since nearly all 
questionnaire items had large projections. 



-346- 



DISCRIMINAOT AXIS 

Item No. Item Description Loading 

33 Compared with all instructors I have .72 

had, both in high school and college, 
this instructor was: (a) one of the 
best (b) above average (c) average 
(d) below average (e) far below average 

31 Is the amount of work done appropriate .68 

to the credit received? (a) received more 

than course warrants (b) received right 
amount of credit (c) received fewer than 
course warrants 

8 Presented the material coherently, .53 

emphasizing the major points and making 
cleai: their relationships 

32 The size of the class was appropriate ,57 

for effective presentation of material 

and for helping all participants to learn 
the subject matter (a) class too large 

(b) class the right size (c) class too small 

30 The instructor drew the majority of his .53 

tests from (a) lectures (b) text 

(c) other reading material (d) equal 
combination of all three 

5 Chose texts for the course which added -.46 

depth to lectures and discussion 

Chi Square =50 df - 36 p ^ .01 

TABLE B3. Standardized projections of question items on 
the third discriminant axis. Items with 



projections less th^jn 0.4 were omitted. 
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APPENDIX C. Multiple discriminant analysis of the faculty (by colleges) 
and administrator responses to the colleague evaluation questionnaire 
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Groiin fCollpep") 






Discr 


iininant Axis 




I 


II 


III 


IV 


1. Brite Divinity 


1.57 


^ 2.75 


4.04 


0.69 


2. Business 


2.71 


1.06 


2.48 


0.46 


3. Education 


3.03 . 


2.. 01 


2.85 


0.85 


4. Fine Arts 


1.78 


1.97 


3.86 


1.60 


5. Humanities 


1.57 


3.47 


2.41 


0.64 


6. Natural Sciences 


0.95 


1.86 


2.40 


1.49 


7. Social Sciences 


0.63 


0.91 


3.47 


0.10 


S. Nursing 


3.27 


1.90 


2.83 


1.61 


9. Administrators 


1.69 


2.38 


3.39 


1;80 


TABLE CI. 


Group mean 


s for the four 


significant discriminant 




axes from 


the analysis of 


the colleague 


evaluation 



questionnaires. 
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Item No « Item Description Loading 

24 Works well as a member of a committee .89 

17 Is someone with whom you have discussed .84 

your teaching 

26 Makes a positive contribution to the .79 

progress of his academic unit through 
committee participation 

19 Expresses interest or concern for the .78 

problems of students 

25 Follows through on committee work by ,77 

appropriate actions and communications 

20. ' Is available and willing to talk with .74 

students on matters of concern 

23 Cooperates with othiirs .74 

14 Is involved in faculty organizations or .74 

committees 

15 Is involved in campus activities that are ,72 

associated with students 

18.. Expresses interest and concern about the .71 

quality of his teaching 

6 Keeps current with developments in his field .71 

29 Serves his profession and community by .68 

service consistent with his primary 
obligation as a teacher^scholar 

12 Can suggest reading in any area of his .68 

general field 

21 Discharges intra-university duties in an .67 

effective manner 

22 Meets deadlines .65 

1 Has gained national or international -.67 

recognition for his work 

5 Is actively engaged in research work or -.93 

professional activf.ties (not related to teaching) 

Chi Square = 166 df » 37 p ^ .001 

TABLE C2. Standardized projections of questionnaire items on the 

first discriminant axis. Items with projections less 

O than 0.65 were omitted. . 

ERIC 
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Item No . Item Description Loading 

9 Seems well read beyond the subjects he .83 

teaches 

3 Does original and creative work .62 

18 Expresses interest and concern about .53 

the quality of his teaching 

13 Attends many lectures and other events ,51 

on campus 

8 Does quality work .51 

Chi Square =90 df = 35 p < .01 

TABLE C3. Standardized projections of questionnaire items 
on the second discriminant axis. Items with 
projections less than 0.4 were omitted. 
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Item No • Item Description Loading 

7 lias done work to which you refer in .76 

teaching 

2 Has done work with which you are ,72 

familiar 

16 Is an active participant in the affairs .70 

of the academic community 

28 Is recognized as an active citizen by 

the community 

4 Expresses interest in the research of .61 

his colleagues 

27 Makes his talent and time available to .58 

the external coiranunity 

29 Serves his profession and community by .57 

service consistent with hi'^ primary 

obligation as a teacher-scholar 

8 Does quality work .55 
22 Meets deadlines .51 

6 Keeps current with developments in his field .51 

13 Attends many lectures and other events on .49 

campus 



Chi Square = 76 df = 33 p <^ .01 

TABLE C4. Standardized projections of questionnaire items on the 
third discriminant axis. Items with projections less 
than 0.4 were omitted. 
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Item Mo . Item Description Loading 

30 Is asked to serve as a consultant .73 

to other organizations 

1 Has gained national or international .59 

recognition for his work 

14 Is involved 5.n faculty organizations ,51 

or committees 

3 Does original and creative work .50 

Chi Square =60 df = 31 p ^ ,01 

TABLE C5. Standardized projections of questionnaire items on 

the fourth discriminant axis. Items with projections 
less than 0.4 were omitted. 
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AN ASSESS>IEOT OF FACULTY PERFOPJIANCE : 
SOME CORRELATES BETWEEN ADMINISTRATOR, 
COLLEAGUE, STUDENT, AND SELF RATINGS 

Robert T. Blackburn* 
and 

Mary Jo Clark 
ABSTRACT 

The study examines the uncf^rtainties surrounding the evaluation 
of faculty work performances and the concerns faculty have regci^rding 
assessments made by them. Separate evaluations of teaching effectiveness 
and overall contribution to the college for 45 full-time (85% response 
rate) faculty members were collected from administrators, faculty 
colleagues, students, and from the professors themselves. 

The very low correlations between the professor and each of his 
role sets are discussed. The inter correlations are also examined for 
their implications. Suggestions are made for improving the evaluation 
of faculty performance and for mitigating the academic man^s uncertainties 
on vital matters affecting his career. 

Faculty complain more about the- manner in which their work is judged 
and rewarded than about any other dimension of their professorial role 
(Guthrie, 1949; Theophilus , 1967). Faculty fret over tenure, promotion, 
merit increases. Most often they believe that deserved honors come too 
late, if at all. 

Nor is their anguish surprising. Most academic men sincerely believe 
they are performing at higher levels than those for which they receive 



^Professor of Higher Education, Center for the Study of Higher Education, 
Ann Arbor, Michigan. 
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institutional and personal recognition. Furthermore, professors can 
document their frustrations with respect to the assessment of their 
worth — ignorance on the part of the evaluators (Gustad, 1967). 
Those who pass judgement seldom witness a perf orrtiance. 

THE PROBLEM AND ITS BACKGROUND 

Teaching 

Teaching is the professor's dominant task and principal activity. 
He gives teaching highest priority, as does his college (Cartter, 1967). 
In addition, teaching is his greatest soivrce of pleasure (Gaff and 
Wilson, 1971: 195). 

But how is his pedagogy to be judged vhen there is still no acceptable 
definition of "good" teaching (McKeachie, 1967-1970); Biddle and Ellena, 
1964; Rothwell, n.d.). Furthermore, chairmen and deans — even his peers 
— never see him teach. Even if student evaluation forms are used and 
available to administrators, deans will not publicly claim that those 
who are in the role of apprentices are qualified to judge those who have 
credentials (Kent, 1967). Some faculty sincerely and vociferously protest 
student evaluation (Bryant, 1967; Hildebrand, 1972). Clearly, precious 
little if any scientific data are in hand when judgments on their teaching 
performance are rendered. So, faculty can point to a violation of Academe' 
first principle: valid and reliable evidence for reaching conclusions. 

Re sear ch 

Scholarly output is supposedly a more objective dimension of 
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professorial value.. At least assessing publications can be done. The 
extent to which it is actually performed remains debatable. Besides, 
inferr*a>c, teaching effectiveness from research productivity remains 
precarious. First of all, expert opinion differs widely. Two 
quotations capture the beliefs that divide faculty, administrators, 
and students: 

Teachers cannot remain stimulating unless they also continue 
to learn, and while this learning may not focus on small, manageable 
"research problems", it is research by any reasonable definition. 
When a teacher stops doing it, he begins to repei.-^.t himself and 
eventually lories touch with both the young and the world around him. 
So says Jencks and Riesman (1968). But John Fischer (1968) asserts: 

"The standard defense for this emphasis on research is that 
man cannot be a good teacher unless he is constantly learning 
something new; in theory, research and teaching go ham? in hand. 
But in practice, they don't." 
The Relationship of Teaching to Research 

The few studies conducted on the relationship between research and 
teaching show either no relationship or at best a slight positive 
association. At the University of Washington, Voeks (1962) found very 
low correlations. Publishing and effective teaching do net go hand in 
hand; however, neither do they conflict. In an unpublished paper of 
preliminary findings at Purdue University, Feldhusen and McDaniels (1967) 
found nine correlations between different statements on teaching 
effectiveness and faculty productivity that fluctuated almost exactly 
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around zero. At Kansas State University, Hoyt (1970) found no significant 
correlation between faculty publications and teaching effectiveness. Also, 
Hayes' (1971) investigation at Carnegie-Mellon University yielded low 
relations between these variables although other interesting findings on 
administrator ratings of faculty were uncovered. 

On the other hand, other contemporary invest ige.tions report small, 
positive correlations. At Tufts University, Bresier (1968) discovered a 
positive association between student judgement of teaching effectiveness 
and the professor's possession of a research grant. At the University 
of Illinois, Stallings and Singhal (1969) obtained small but significant 
correlations (r approximately »25) between product* ^'?'i;:y as measured on 
a publication scale and student ratings of teacher ef f^activeness . While 
the positive relationships was true for all ranks, the higher ranked 
professors also had higher productivity and higher student ratings. In a 
second study done at Purdue University, McDaniels and Feldhusen (1970) 
did find a positive relationship between faculty ratings and indices of 
scholarship when scholarship is measured in an indirect way (baing second 
author in a major publication). However, their other and numerous measures 
of productivity correlated close to zero with their ratings as teachers. 

Finally in pilot investigations at the University of Wiscotiisin and 
at Stanford, Hammond, Meyer and Miller (1969) found students and faculty 
disagree about teaching effectiveness and its relationship to research. 
They speculate that the reason the correlations may hover around zero is 
due to the fact that faculty judge a colleague to be a good teacher if and 
only if he is doing research. Meanwhile, students believe that the 
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teacher who is poor in the classroom is so because he is spending all of 
his time on research, and vice versa. Thus, faculty and student inter- 
pretations of the performance of a professor are on perpendicular axes. 
Their untested hypothesis could account for the low relationship most have 
obtained. ^ 

Agreements Between Evaluators 

Administrators and faculty members persist in assuming a positive 
relationship between teaching and research as they make judgements about 
promotions, tenure, and salary increases. Even the professor assumes 
a single conception of academic worth which specifies that if a colleague 
is doing research, his classes are ipso facto superior. Yet Hussain and 
Leestamper (1968) discovered the criteria used for judging teaching 
effectiveness by students and administrators w^re not the ones given most 
importance by faculty. In fact, those that faculty thought most 
important were not even on the list. In a study by Crawford and Br&dshaw 
(1968), each of ten subgroups — • assistant professors and instructors, 
associate and full professors, department chairmen, deans, and six student 
groups div'd'^d by sex and three levels of ability — differed in a 
statistically significant way from all other sub-groups in the rating 
given to the most important characteristics of effective university teaching. 



Service, the last of the troika of faculty roles — committee work, 
advising, community relations, professional assistar.ce from expertise — 
remains even more subjective. The value placed on it is uncertain. 
Equally, uncertain l^s the way it is assessed by those who reward faculty. 
The ambiguity increases faculty apprehcnr,ion regarding those who hold 
power to sanction. The service role is not discussed in this research. 
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Birnbaxim (1966) found inconsistencies in faculty evaluation at the contmunity 

college level. 

Pr omotion and Merit Raises 

F.^-nally, two studies underscore the faculty's genuine concern on how 
they are assessed and rewarded. Luthans (1967) revealed that while deans, 
department chairmen, and other administrators believe that teaching is the 
most important function for faculty, and that faculty agree, administrators 
confess that promotion is judged on ot^er criteria, e.g., research. 
However, Luthans found no relationship between research and promotion. 
Similarly, Hoyt (19 70) uncovered no significant relationships between 
either rate of promotion or receipt of merit raises with either teaching 
effectiveness or publication record. He did find differences between 
academic disciplines and a slight indication that above average raises 
are more clearly related to teaching effectiveness at the early stage of 
a man^s career and to publications at a later stage. 

So, faculty are not schizoid when they complain about matters oi: 
recognition for their efforts. Whether ther are judged well or poorly 
matters, of course. Equally important, however, is their firm conviction 
that 'they are not judged properly. 

Improving the assessment process is therefore extremely important. 
Sorting out fact from folklore as well as from unfounded belief is the 
first step. 

\'/hile several studies of faculty teaching effectiveness have utilized 
student evaluation, and a few have used peer ratings, this research 
combines these two sources and introduces both administrative and self- 
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evaluations. It also expands the notion of faculty work perf oraance 
so as to include dimensions other than teaching effectiveness, and 
publications, A Global rating on overall contribution to the college 
serves as independent measure. The findings provide rich insight into 
faculty values. The unexpected results also have serious implications 
for behavior within academia. 

SETTING AND METHODOLOGY 

The study was conducted at '"Midwest" college. Her fifteen hundred 
students encompass a full range of interest and academic qualifications. 
A moderately well-trained faculty spreads over the typical departments. 
While the participation from the approximately twenty-five part-time 
faculty x^as respectable, other factors led to restricting the analyses 
to full-time faculty. ?orty-five of the fifty-three faculty (85%) in the 
latter category responded to all measures. 

As l^dwest grov/s , she is experiencing a separation from her founding 
church both in support and in control. In these and other ways Midwest 
is like many other American colleges and is nearly dead-center with respect 
to her cohorts of more than eight hundred private and church-related 
liberal arts colleges. And, as the principal faculty roles are teaching 
and contributing to the organization, Midwest is not unlike miany emerging 
state colleges and universities except, of course, with respect to size. 

Having convinced themselves that self -analysis was necessary for 
major change, Midwest faculty willingly participated in a series of self-- 
studies. Aiuoiig other things, they rated colleagues and themselves on 
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teaching effectiveness and overall contribution to the college. Midwest's 
administrators also rated faculty members on both dimensions of performance. 
Student evaluations of teaching effectiveness were also obtained. A 
sample of faculty participated in a second set of ratings to provide an 
estimate of measurement reliability. 

Specifically, each faculty member rated every other teacher in his 
curricular division and himself on a five point scale of "teaching 
effectiveness." Administrators also rated faculty. In doing so, the 
faculty member was told to "consider those qualities which are important 
in the evaluation o: the skills and practices and products of a class- 
room te acher regardless of rank or experience or teaching of the person 
being rated." In a similar way, each faculty member judged himself and 
each colleague on a five point scale concerning his "overall contribution" 
to Midwest College. Again, administrators rated faculty. The rater vas 
told to "take into account the person's total contribution, whether his 
own work or his stimulation of others, whether scholarly or administrative 
or in human relations; the person's overrill usefulness in helping the 
college carry out its responsibilities." 

Student evaluations of teaching effectiveness V7ere obtained from 

a standard lA item, five point scale questionnaire to evaluate all courses 

each semester. Responses to the question "How would you rate your 

instructor in teaching effectiveness?" were averaged across all courses 

taught by a faculty member during one semester for an index of his 

2 

teaching performance as judged by students. 



Cartter's (1966) methodology is employed. Expert judgements on what in 
essence is quality, an attitude of value, are used. An intensive analysis 
was conducted to establish the reliability and validity of the technique. 
The successful effort is reported in considerable detail in another paper 
Q (Clark and Blackburn) . 
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FINDINGS 



The intercorrelations are collected in Table 1, To begin with, 
different ratings on the two performance dimensions demonstrate 
discrimination was made between teaching effectiveness and overall 
contribution to the college by the same group of raters. Secondly, the 
rated teaching effectiveness correlates significantly with similar 
ratings by administrators and studer.ts, (The correlation between 
administrator and student ratings on teaching effectiveness, although 
lower (.47), is also statistically significant). However, among self- 
ratings, only colleague ratings on overall contribution to the college 
demonstrate a significant relationship. Even that is only 0,33, Self- 
ratings on teaching effectiveness have near zero correlations with 
ratings with each of the other tihree groups of raters. 

Said another way, professors appear to view their own teaching 
effectiveness and overall contribution to the college in nearly 
interchangeable ways (r = .72). Their performance on one trait is viewed 
as being much like their performance on the other. At the sarae time, 
they make clear distinctions between the two traits when rating their 
peers. There is little commonality between self-perceptions of teachiiig 
effectiveness and judgements on this same dimension by colleagues, students, 
and administrators (0.28, 0.19, and 0.10 respectively). There is, 
however, fair agreement among the three independent groups of raters (.63, 
.62, and .47)- There is agreement between self and colleague on overall 
contribution to the college (,45). However, between self and administrator 
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ratings on this dimension — the key relationship for the faculty nember's 
concern, the correlation is very lov, 0.15. 

CONCLUSIONS 

Conclusions from the data are that: 

1., Apparently, chere is considerable variation in the factors 
that enter into performance Judgements as whey are made by , 
colleagues, students, administrators, and self. 

2. Self ratings on the same performance dimensions show 

little agreement with ratings made by faculty colleagues 
and almost no relationship with judgeiTien*:s made by 
administrators . 

3* Colleague judgements about teaching performance are positively 
related to their Judgements about professional productivity 
of a faculty member. 
4, Colleague and student judgements about teaching performance 

are in substantial agreement. 
On the one hand, the data support the use of ratings by both colleagues 
and students in the evaluation of faculty performance. But, on the other 
hand, they demonstrate a reason why an individual faculty member often 
claims that his work is properly appreciated. Furthermore, this feeling* 
is most likely to arise when decisions about his future are being made 
primarily by administrators, for his per-aeption of his performance shows 
the least relationship to their judgements. The professor lives with 
an erroneous perception of how others perceive and assess him. 
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DISCUSSION AND lOTLlCATIONS 

Such a striking outcome evokes a natural response, "Why?" Immediate 
explanations are wanting. The chasmr. which separate perception 
of self from all significant others flaunt a basic premise I hold dear 
when conducting my daily life. I truly believe I know how I am doing, 
especial7.y on matters which mean the most to my existence ~ say, 
teaching. >ac:>ybe others do not, but I certainly do. To psychologically 
accept the conclusion that I err here is anything but- easy. 

One defense questions the finding^;, 

3 

The reliabilities of the instruments have already been presented. 
The generalizability of the findings cotiie into question, the possibility 
that "Midwest" is after all unique. Dissertation Abstracts reports three 
studies, (Chdy, 1969; Morgenstern, 1969; Basham, 1970) in Colorado which 
corroborate the general findings here — significant correlations between 
students, faculty, and administrators on teaching effectiveness and non- 
significant outcomes between self and all others. Hence, this recourse 
. strengthens rather than weakens confidence in the outcomes. 

A second category of possible explanations raist?.s questions with 
respect to the validity of the instruments, the student evaluation of 
teaching effectiveness, for example. Are student ratings not influenced 
by grade received, happiness more than learning, a halo effect, ... a 
long list? Recent reviews of the extensive research on this topic by 
Blackburn (1971), Costin (1971), and Hildebrand (1972) dispel this 
outlet. Student ratings arc hif^hly reliable and free from contaminations. 

3 

Self-ratings are the possible exception. They are single measurements 
and, therefore, with lower reliability than the mean ratings used to represent 
judgements by colleagues; students, or administrators. The effect of this 
^ difference is an unknown quantity in the statistical analyses. 

ERIC 



In addition, earlier Maslow and Zimmerman (1956) found nearly identical 
correlation coefficients between student and faculty colleague rating of 
ter'^hing ef f ectiv uaess , .69 as compared to .63. Their research at a 
New York University supports rat>"i*. than questions the findings at Midwest 

Ai:other approach to challenge the principal finding inspects the 
sources of information each role set has and does not have for making 
judgements with respect to faculty performance. While more speculative 
than document able — and uence, as hypotheses for research rather than 
fact — this analysis sheds some liglrit on the unexpected results. 

To begin, with respect to a professor's teaching effectiveness, 
students, of course, have direct experience. Only small random errors 
affect their rating scores. Faculty, on the other hand, almost always 
have only indirect observations of a colleague's teaching ability. No 
doubt they have overheard him while walking down the hall, or momentarily 
have seen him performing as they pansed by a windotAj. In some instances, 
:.hey may have attended a public lecture of his, or more rarely, co-taught 
a course with him. However, even at best, these observations constitute 
a small sample of a professor's time in class, most likely a non-j.caadom 
sample. They might, however, be an adequate measure if the man to be 
judged utilizes but a single style from the large repertoire of available 
teaching techniques. 

Students supply faculty with other information about their colleagues 
Overhear in an excii:?.n,3c. hetv/een a professor and a student is one source. 
Acadeiaic counseling with respect to current work or future courses is 
another, a function which sometimes triggers an advisee's unsolicited. 
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coimnents about a colleaguG (not infrequently causing embarrassment and 
raising questions of professional ethics when a student expects a 
favorable acknowiedgeraent after delivering a tirade), l^hat kind of 
examinations and papeT-<5 a professor gives and the way he grades frequently 
become **known" through students, even when not sought • 

Also, professors chat about their peers, especially about their 
reputatioii. This secondary source becoiaes more detailed in the case of . 
a colleague who stands at either of the extremes of the pedagogical 
scale. No doubt the '^average" classroom performer commands less gossip. 

.Finally, inferences are drawn about a man's teaching effectiveness 
on the basis of person to person interactions with him — on committees, 
in faculty meetings, socially, what he writes, in a whole host of vays. 
What factors determine -Judgements are not really known. One study 
(Isaacson, McKeachie, and Milholland, 1963) found the highest correlation 
with respect to peer (psychology teaching fellows in this case) rating 
of teaching ability was with their assessment of the man's cultural 
sophistication. Maslow and Zimnerman (1956) acquired a correlation of 
.77 between faculty ratings of colleagues' on teaching effectiveness 
and their judgement of his creativity. 

No doubt faculty assessment is made on the basis of all of the 
factors and experiences just delineated, as well as oa others. Most 
likely, however, the last mentioned — person to person interactions — 
dominates, unless student and/or reputational feedback is overwhelming. 
Consequently, there arc persuasive grounds to expect the high 
correlation found between student and faculty ratings of teaching effective 
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ness, however, what has been desci'lbed thus far gives no compelling 
reasons for believing that the correlation between a man's peers and 
himself should be of any particular value — positive, negative, or 
zero. 

Turning to the bases on which administrators form opinions on 
a professor's teaching ability, student input on faculty is anything 
but random. Extremes predominate. Department heads and deans will 
learn who the very popular instructors are from student talk. But the 
student who makes an office call seldom does so to praise a professor. 
Only when students havo. been unable to resolve grievances farther down 
the line do they speak directly to administrators about the teaching 
practices of a professor. He is seeking redress from an unfair grade, 
an intolerable required class, matters on which he heaps the principal 
blame onto the instructor. His teaching is anything but praised. 

Administrator information aoout faculty, who themselves are only 
partly knowledgeable about a professor's teaching effectiveness, must 
be di£;torted, eVen on those rare occasions when it exists. Faculty 
don't ordinarily talk, with deans abo\it a collt^ague's teaching ability, 
except as a member of a personnel committee deliberating promotions* 
Similarly, information from lower le\'el administrators contains a large 
noise factor. 

In all, then> 5^. is not surprising that the correlations between 
administrators and both students and faculty are "'^wer than those existing 
bcuT^een the two constituencies who are closer to the professor. Also, 
that the correlation is positiv?. is to be expected. However, of 
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v/hau magnitude it has ir» unpredictable from anything but an ex post 
facto analysis. 

As ^-cr the man himself, some events suggest him to be an out- 
standing judge of his teaching effectiveness. Others indicate just 
the opposite* 

For example, the majority of his student interactions are with 
those who hold him in high esteem. It is the students who like his 
course and his teaching that come after class, continue discussions 
in the hallways > join him for coffee, drop into his office, become 
his majors. The indifferent and despisers, no matter what their 
proportions in relation to the true believers, give him no feedback. 
\^y should they bother? Hence distortion in self-appraisal follows 
from the non-raudomness of the feedback. 

The possibility suggests itself that the more mature academics 
would be more discriminate in judging themselves, especially those who 
had enjoyed some measure of success. They would better know their 
strengths and weaknesses than would those earlier in their career. 
The data, however, did not reveal such differences. (The sample size 
did not permit tests of refined subgroups. Thio hypothesis needs to 
be tested in a larger settinc^) . 

Another dimension enters when it is recalled that the primary 
reason a man chose to become a professor was because he wanted to teach. 
Furthermore, he believed he would be good. He established some 
performance goals and judges hiiriself on self-selected standards. Failure 
in teaching effectiveness is failure in life; no inconsequential outcome. 
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As Goffman (1959) demonstrates ^ the management of self is vitally 
important. How I present myself to significant others can confuse 
others as well as myself. Do I take a class out on the lawn in Spring 
to show students I have not passed the generation gap? Do I mention 
to colleagues some outstanding term papers I have received to indicate 
I extract the best frotn students? Do I show that I have high standards 
by publicly expressing my disappointment in how poorly a class did 
on an examination? Do I exchange pleasantries with the Dean at a 
concert to be certain he knows I attended, or because I genuinely 
like him and naturally interact or both? 

Sure, I too wear one of Pirandello's masks. Doesn't everyone? 
After all, there is a limit to how much the self can take. But all 
false images aside, I know who I am. I know how I am doing. 

VJhy self correlations hover around zero becomes less surprising 
as professorial roles are examined. Nonetheless, the consequences of 
near zero correlations lessen not at all. Before turning to these, 
a similar but briefer analysis \<r±th respect to overall contribution 
to the college is presented. 

As for colleague ratings, again meetings and committees and the 
like predominate. Unlike the case of teaching ef f ectiveness, 
administrators now have direct evidence as they join with faculty as 
colleagues in the efforts. Negative feedback drops at the same time 
they mentally note vjho gets elected to what committees. A professor's 
support for a proposal of theirs will be known, as will be the frequency 
with which a professor comes forward with new ideas for the good of the 
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college* The expectation would be that colleagues and administrators 
would tend to agree in their ratings of a nan's overall contribution 
to the organization 5 as they do. 

Lastly, what information does the man receive and how reliable is 
it? In Tvhat ways does he respond to favorablt: feedback, to .negati' e? 

For example, should he view h:.-s appointment to the library coniT\ittee 
as praise, or as failure, or neither? Is he there because he orders 
more books than all others and they need his expertise? Or is he on 
this low status committee (everybody has to be on at least one) because 
he has been judged unworthy to influence educational policies? 

Put another way, I know good teaching is my college's highest 
value. I work hard at it, very hard. I acknowledge that £ome of my 
peers are more dynamic, outstanding showmen. In fact, I am jealous, 
envious, I wish I had their performance talents. But then. I tell 
myself, genuine teaching is more than a good show. I know that. So 
do students, faculty, and administrators, really . My style may be 
lacking in glamour, but 1 really^ care* Sure, some days are better than 
others. Likewise, for some courses. But, and this is all that really 
matters, my students ge n uinely learn from me, more than they do from 
any colleague, actually — bar none. 

But, I have one fl^^v;. I do not know that the correlation between 
my judgement on my teaching effectiveness and each of my^other 
constituencies is essentially zero. I see my teaching effectiveness 
as highly correlated with my overall contribution to the college. Little 
do I know that my opinion correlates .15 with the boss. 
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The implications are many. For example, in essentially zero 
correlations, there is a random scatter of points on a chart plotting 
^elf and others* judgements. A complete scatter means a few individuals 
perceive themselves as others do. However, most do not. Furthermore, 
there is no way to predict who does and who does not. So, even those 
who are accurate don't know they are. 

One of the extremes is the individual who rates himself at the top 
and others score him at the botton:.. lie has a very long fall when the 
message arrives that he is being let go — and everyone else thinks he 
should be. That he is persisting in such a state of misperception is 
frightening. 

Nor is the other extreme any l^iss awesome, both from a human and 
from an organizational point of view. Since such a professor resides 
in ignorance of the fact all others judge him outstanding, or if told, 
he believes non a word, the man who has judged himself a failure \7±11 
either resign or act to altjer his ways drastically. In the eyes of all 
others, the latter decision can only move him downward. Again, the 
outcome of ignorance overwhelms. 

What should be done? 

Social scientists deal with such discrepancies in perception in 
a variety of well kncxm ways — in formation exchange, T-groups, performance 
appraisals. Such procedures are our recommendations, too, but with 
warnings . 

For exaTiple, research on performance appraisax practices ccmes 
from business and industry. Meyer, Kay and French (1965) and French, 
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Kay anu Meyer (1966) uncovered some of the factors which can alleviate, 
the unsatisfactory results General Electric was having. However, the 
practice has not spread,, despite its intuitive attraciiveness , an 
indication of troubles remain. Now performance contracts are the talk 
in higher education. P*^ sic -'s involved. Care must be exercised. 

At any rate, students, faculty and administrators might sit dc\m and 
inspect the data. Communication lines have not been established that 
make clc-ar what it is that is expected of a professor by each of the 
sub-groups — to say nothing of vjhether or not any human being can 
satisfy people wlio have very diverse, even conflicting demands. 
Conversations regarding expectations are the very least that must be done. 

Too often colleges and universities assess the faculty member lust 
before an important decision with respect to his and the institution's 
future must be made. The Personnel Committee meets in December before 
AAUP deadlines; this is its first meeting on a man. A negative judgement 
at thst time leaves no alternatives. No corrections can be made; no 
learning takes place. Not only is such a procedure psychologically 
harmful to all parties; it also is contrary to the aims of the institution 
as a human organization. 

In those few colleges and universities where assessment of faculty 
is a re^jular process (as opposed to a final judgement) , evaluation devices 
are not tests and/or final examinations on Xxzhich all hinges, l^en 
improvement of teaching is the a:.m, then the institution is an educational 
rather than a punitive one. Faculty vir=^it other faculty's classes, and 
have their o\m observed. Coffee aftey.-wards allows immediate reaction. 
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Student opinion is sought along the way and openly shared, not done in the 
absence of the professor in sealed enveloi;;' v unavailable until grades 
are in at the close of the term. I'/hen continuous evaluation is practiced, 
it appears that professional effectiveness increases and faculty growth 
occurs. Certainly such processes can mitigate the uncertainties and 
frustrations haunting many faculty when theit efforts are assessed. 

EPILOGUE 

We would be less than honest if we did not append a haunting dream. 
There are, after all, some very fine humanists who chuckle at the surprise 
We express in our findings and at our recommendations for action. Un- 
enamored by correlation coefficients of any magnitude, and generally 
deploring any f ractionalization of the human whole, they knew the scientific 
establishment v;as bound to fall, as it has. That social scientists 
likewise perform no miracles surprises them not at all. 

After all, long before Lear and well after Willie Loman, the humanists 
have captured the essence of the human condition — tragedy. The very 
essence of tragedy, of humanity, is the unalterable inability of the 
individual to perceive the world as she views him. 
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